-- Logs begin at Tue 2022-10-04 02:50:12 UTC, end at Tue 2022-10-04 03:47:14 UTC. -- Oct 04 03:20:55.697217 dv-cinder-849143-9-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 03:20:55 2022] *** Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: nodename: dv-cinder-849143-9-smb Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: machine: x86_64 Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: clock source: unix Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: pcre jit disabled Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: detected number of CPU cores: 4 Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: current working directory: / Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: detected binary path: /usr/bin/uwsgi-core Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: your processes number limit is 47680 Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: your memory page size is 4096 bytes Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: detected max file descriptor number: 2048 Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: lock engine: pthread robust mutexes Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: thunder lock: enabled Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 03:20:55.710436 dv-cinder-849143-9-smb devstack@n-api.service[105395]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 03:20:55.748628 dv-cinder-849143-9-smb devstack@n-api.service[105395]: Python main interpreter initialized at 0x5566846429c0 Oct 04 03:20:55.748628 dv-cinder-849143-9-smb devstack@n-api.service[105395]: python threads support enabled Oct 04 03:20:55.748628 dv-cinder-849143-9-smb devstack@n-api.service[105395]: your server socket listen backlog is limited to 100 connections Oct 04 03:20:55.748628 dv-cinder-849143-9-smb devstack@n-api.service[105395]: your mercy for graceful operations on workers is 90 seconds Oct 04 03:20:55.748959 dv-cinder-849143-9-smb devstack@n-api.service[105395]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 03:20:55.749038 dv-cinder-849143-9-smb devstack@n-api.service[105395]: *** Operational MODE: preforking *** Oct 04 03:20:55.749285 dv-cinder-849143-9-smb devstack@n-api.service[105395]: *** uWSGI is running in multiple interpreter mode *** Oct 04 03:20:55.749285 dv-cinder-849143-9-smb devstack@n-api.service[105395]: spawned uWSGI master process (pid: 105395) Oct 04 03:20:55.749485 dv-cinder-849143-9-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 04 03:20:55.750019 dv-cinder-849143-9-smb devstack@n-api.service[105395]: spawned uWSGI worker 1 (pid: 105396, cores: 1) Oct 04 03:20:55.750350 dv-cinder-849143-9-smb devstack@n-api.service[105395]: spawned uWSGI worker 2 (pid: 105397, cores: 1) Oct 04 03:20:55.750507 dv-cinder-849143-9-smb devstack@n-api.service[105395]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 03:20:56.405139 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 03:20:56.426975 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 03:20:57.488369 dv-cinder-849143-9-smb devstack@n-api.service[105396]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 03:20:57.488369 dv-cinder-849143-9-smb devstack@n-api.service[105396]: from cryptography.utils import int_from_bytes Oct 04 03:20:57.488965 dv-cinder-849143-9-smb devstack@n-api.service[105396]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 03:20:57.488965 dv-cinder-849143-9-smb devstack@n-api.service[105396]: from cryptography.utils import int_from_bytes Oct 04 03:20:57.490754 dv-cinder-849143-9-smb devstack@n-api.service[105397]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 03:20:57.490754 dv-cinder-849143-9-smb devstack@n-api.service[105397]: from cryptography.utils import int_from_bytes Oct 04 03:20:57.491209 dv-cinder-849143-9-smb devstack@n-api.service[105397]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 03:20:57.491209 dv-cinder-849143-9-smb devstack@n-api.service[105397]: from cryptography.utils import int_from_bytes Oct 04 03:20:59.977757 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 03:20:59.978296 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 03:20:59.978519 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 03:20:59.978879 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 03:20:59.979130 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 03:20:59.979538 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.979781 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 03:20:59.980128 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.980304 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 03:20:59.980388 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.980480 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.980564 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 03:20:59.980783 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.980896 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 03:20:59.981091 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.981195 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 03:20:59.981405 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.981520 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.981718 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.981843 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.982041 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.982162 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.982296 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.982478 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.982607 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.982804 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.982926 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-9-smb {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.983113 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.983243 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.983429 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.983568 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.983770 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.983874 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.984096 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.984189 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.984353 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.984473 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.984665 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.984788 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.984986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-9-smb {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.985693 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.985840 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.986149 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.986253 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.986455 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.986612 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.986775 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.986922 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.987091 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.987276 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.987407 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.987722 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.987824 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.987916 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.988178 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.988273 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.988492 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.988579 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.988798 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.988884 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.989117 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.989208 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.989421 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.989569 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.989762 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.989847 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-9-smb {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.990068 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.990162 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.990384 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.990469 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.990690 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.990780 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.991014 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.991163 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.991321 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.991418 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.991713 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.991816 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-9-smb {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.992030 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.992136 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.992340 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.992435 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.992643 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.992735 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.992964 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.993056 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.993279 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.993377 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.993592 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.993678 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.993905 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.993991 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.994200 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.994293 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.994505 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.994589 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.994809 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.994893 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.995123 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.995220 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.995421 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.995693 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.995793 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.995873 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.995979 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.996072 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.996281 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.996366 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.996599 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.996691 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.996915 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.997001 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.997232 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.997337 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.997483 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.997606 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.997731 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.997822 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.998048 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.998138 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.998364 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.998473 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.998669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.998763 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.998973 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.999066 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.999226 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.999332 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.999473 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.999588 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.999810 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:20:59.999902 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.000130 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.000217 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.000438 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.000523 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.000795 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.001508 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.001599 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.001678 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.001897 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.001982 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.002199 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.002296 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.002504 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.002598 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.002809 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.002901 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.003114 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.003207 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.003432 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.003585 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.003761 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.003852 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.004078 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.004170 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.004384 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.004476 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.004692 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.004775 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.005007 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.005104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.005321 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.005404 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.005624 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.005707 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.005928 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.006018 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.006231 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.006322 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.006550 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.006635 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.006871 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.006963 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.007170 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.007253 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.007416 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.007525 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.007744 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.007840 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.008044 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.008129 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.008359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.008444 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.008663 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.008750 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.008966 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.009050 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.009225 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.009318 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.009527 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.009612 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.009830 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.009921 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.010133 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.010224 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.010439 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.010522 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.010739 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.010823 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.011039 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.011137 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.011336 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.011428 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.011656 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.011751 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.011959 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.012057 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.012259 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.012348 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.012557 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.012641 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.012858 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.012951 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.013160 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.013245 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.013460 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.013553 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.013760 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.013845 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.014060 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.014150 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.014360 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.014443 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.014673 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.014764 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.014972 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.015063 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.015274 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.015358 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.015596 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.015684 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.015900 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.015995 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.016199 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.016300 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.016539 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.016641 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.016843 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.016928 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.017147 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.017232 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.017460 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.017545 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.017761 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.017872 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.018063 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.018159 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.018377 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.018484 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.018682 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.018790 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.018983 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.019077 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.019282 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.019377 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.019608 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.019701 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.019913 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.020057 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.020231 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.020324 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.020535 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.020620 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.020838 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.020929 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.021132 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.021223 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.021430 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.021513 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.021733 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.021880 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.022031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.022118 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.022330 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.022413 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.022627 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.022723 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.022924 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.023021 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.023236 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.023321 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.023581 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.023702 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.023890 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.023995 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.024193 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.024286 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.024495 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.024588 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.024811 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:21:00.024904 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.025139 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.025240 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.025449 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.025543 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.025759 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.025852 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.026081 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.026176 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.026387 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.026488 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.026695 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.026789 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.027004 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.027108 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.027320 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.027419 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.027654 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.027746 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.027979 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.028085 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.028286 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.028402 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.028594 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.028709 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.028904 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.029006 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.029378 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.029480 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.029563 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.029632 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.029828 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.029932 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.030140 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.030254 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.030448 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.030534 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.030759 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.030858 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.031068 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.031154 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.031383 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.031479 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.031731 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.031875 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.032094 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.032180 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.032464 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.032547 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.032773 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.032870 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.033080 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.033166 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.033419 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.033503 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.033728 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.033894 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.034083 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.034222 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.034347 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.034432 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.034655 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.034741 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.034972 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.035064 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.035280 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.035365 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.035609 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.035712 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.035921 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.036008 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.036227 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.036323 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.036533 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.036620 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.036853 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.036938 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.037161 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.037254 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.037470 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.037554 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.037778 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.037862 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.038088 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.038194 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.038395 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.038481 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.038698 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.038803 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.039007 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.039114 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.039310 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.039395 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.039630 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.039736 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.039933 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.040027 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.040233 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.040318 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.040542 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.040627 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.040840 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.040926 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.041148 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.041232 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.041451 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.041535 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.041750 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.041835 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.042048 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.042135 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.042355 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.042440 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.042657 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.042749 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.042959 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.043043 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.043264 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.043349 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.043586 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.043687 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.043896 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.043990 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.044201 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.044302 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.044502 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.044588 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.044808 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.044891 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.045111 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.045206 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.045411 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.045502 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.045720 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.045812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.046017 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.046115 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.046319 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.046405 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.046628 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.046712 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.046935 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.047031 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.047238 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.047322 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.048104 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.048278 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.048447 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.048535 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.048755 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.048950 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.049077 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.049379 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.049502 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.049688 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.049815 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.050114 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.050213 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.050470 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.050582 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.050773 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.050972 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.051102 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.051404 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.051536 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.051749 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.051846 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.052053 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.052165 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.052350 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.052461 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.052649 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.052747 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.052949 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.053046 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.053248 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.053353 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.053553 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.053649 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.053850 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.053949 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.054150 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.054255 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.054450 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.054553 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.054777 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.054872 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.055079 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.055191 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.055386 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.055519 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.055715 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.055813 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.056018 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.056122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.056342 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.056444 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.056641 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.056737 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.056973 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.057075 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.057272 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.057380 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.057591 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.057686 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.057974 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.058078 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.058334 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.058436 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.058604 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.058701 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.058912 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.059352 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.059655 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.059966 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.060275 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.060583 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.060899 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.061210 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.061523 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.061828 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.062160 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.062381 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.062479 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.062725 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.062821 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.063036 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.063145 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.063926 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.064085 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.064246 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.064390 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.064754 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.064963 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.065070 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.065380 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.065570 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.065675 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.065988 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.066083 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.066294 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.066403 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.066599 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.066698 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.066907 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.067018 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.067215 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.067312 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.067549 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.067676 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.067858 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.068000 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.068173 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.068334 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.068480 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.068656 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.068800 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.068991 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.069107 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.069323 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.069494 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.069647 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.069772 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.070011 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.070155 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.070331 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.070659 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.070745 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.070964 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.071553 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.071654 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.071874 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.072181 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.072305 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.072488 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.072713 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.072800 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.073058 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.073145 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.073372 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.073465 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.073683 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.073791 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.073996 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.074095 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.074305 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.074412 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.074611 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.074709 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.074913 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.075010 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.075224 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.075330 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.075553 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.075652 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.075857 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.075998 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.076166 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.076311 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.076648 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.076863 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.077077 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.077291 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.077521 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.077751 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.077967 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.078202 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.078419 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.078813 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.079064 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.079294 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.079584 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.079845 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.080089 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.080333 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.080585 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.080931 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.080931 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.081224 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.081387 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.081540 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.081683 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.081824 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.081964 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.082104 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.082245 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.082484 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.082639 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.082782 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.082921 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.083061 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.083201 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.083365 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.083557 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.083705 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.083846 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.083985 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.083985 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.084266 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.084408 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.084408 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.084671 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.084810 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.084810 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.085083 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.085243 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.085384 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.085523 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.085663 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.085810 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.085958 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.086099 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.086244 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.086385 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.086575 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.086729 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.086870 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.087009 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.087168 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.087386 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.087749 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.087997 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.088148 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.088289 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.088430 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.088568 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.088741 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.088741 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.089021 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.089162 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.089317 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.089459 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.089611 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.089611 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.089876 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.090015 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.090015 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.090374 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.090516 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.090663 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.090803 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.090803 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.091174 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.091334 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.091334 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.091646 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.091787 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.091926 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.092065 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.092204 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.092342 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.092507 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.092724 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.092870 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.093017 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.093158 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.093306 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.093455 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.093603 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.093744 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.093890 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.094037 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.094187 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.094327 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.094466 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.094674 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.094912 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.094912 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.095279 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.095434 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.095620 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.095762 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.095762 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.096025 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.096176 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.096317 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.096456 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.096456 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.096769 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.096909 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.097056 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.097215 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.097215 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.097482 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.097628 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.097776 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.097916 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.097916 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.098187 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.098334 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.098475 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.098620 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.098760 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.098900 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.099049 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.099246 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.099393 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.099579 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.099762 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.099920 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.100149 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.100305 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.100446 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.100677 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.100832 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.101090 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.101257 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.101399 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.101545 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.101686 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.101834 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.101974 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.102192 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.102338 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.102485 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.102773 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.102936 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.103089 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.103227 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.103384 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.103557 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.103714 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.103961 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.104109 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.104249 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.104389 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.104557 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.104713 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.104853 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.104993 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.105132 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.105271 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.105421 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.105570 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.105719 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.105860 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.105999 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.106146 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.106299 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.106448 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.106594 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.106782 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.106926 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.107065 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.107216 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.107369 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.107534 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.107682 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.107837 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.107979 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.108125 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.108266 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.108405 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.108545 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.108690 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.108838 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.108987 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.109127 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.109278 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.109418 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.109557 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.109713 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.109855 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.110570 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.110805 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.110990 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.111152 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.111377 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.111596 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.111751 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.111904 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.112045 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.112184 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.112333 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.112482 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.112623 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.112769 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.112994 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.113140 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.113302 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.113444 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.113591 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.113741 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.113891 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.114040 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.114181 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.114330 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.114471 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.114611 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.114750 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.114903 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.115044 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.115183 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.115321 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.115460 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.115629 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.115878 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.116022 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.116162 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.116301 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.116447 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.116596 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.116746 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.116935 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.117075 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.117214 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.117353 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.117500 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.117648 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.117807 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.117948 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.118087 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.118226 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.118378 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.118526 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.118673 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.118814 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.118952 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.119091 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.119239 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.119379 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.119556 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.119713 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.119854 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.120003 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.120157 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.120298 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.120446 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.120586 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.120725 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.120873 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.121013 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.121152 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.121291 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.121525 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.121691 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.121871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.122015 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.122167 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.122307 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.122455 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.122595 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.122743 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.122884 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.123105 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.123251 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.123392 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.123565 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.123724 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.123865 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.124005 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.124152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.124293 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.124444 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.124585 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.124731 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.124871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.125054 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.125194 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.125343 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.125493 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.125647 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.126349 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.126494 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.126634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.126782 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.126973 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.127119 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.127268 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.127456 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.127641 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.127804 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.127951 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.128108 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.128255 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.128401 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.128600 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.128751 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.128896 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.129050 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.129204 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.129360 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.129513 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.129661 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.129806 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.129970 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.130117 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.130270 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.130425 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.130571 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.130724 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.130870 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.131014 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.131167 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.131331 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.131513 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.131677 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.131825 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.131980 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.132126 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.132280 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.132428 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.132573 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.132718 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.132863 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.133016 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.133247 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.133400 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.133547 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.133701 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.133847 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.134017 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.134165 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.134311 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.134456 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.134602 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.134749 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.134909 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.135056 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.135209 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.135355 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.135555 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.135711 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.135868 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.136027 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.136173 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.136318 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.136463 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.136618 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.136764 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.136922 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.137111 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.137111 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.137395 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.137549 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.137697 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.137697 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.137985 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.137985 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.138260 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.138415 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.138569 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.138717 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.138863 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.139008 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.139153 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.139311 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.139459 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.139642 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.139803 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.139950 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.140104 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.140250 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.140395 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.140541 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.140686 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.140841 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.140996 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.141142 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.141318 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.141471 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.141617 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.141773 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.141933 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.142080 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.142226 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.142371 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.142517 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.142517 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.142803 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.142951 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.143103 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.143266 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.143509 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.143680 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.143851 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.144006 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.144152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.144297 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.144450 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.144672 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.144827 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.144975 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.145127 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.145294 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.145449 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.145596 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.145754 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.145914 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.146063 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.146216 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.146362 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.146508 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.146654 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.146809 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.146956 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.147144 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.147295 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.147441 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.147615 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.147789 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.147937 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.148083 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.148237 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.148382 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.148541 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.148695 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.148848 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.149001 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.149148 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.149294 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.149449 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.149596 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.149753 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.149899 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.150045 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.150192 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.150347 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.150494 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.150640 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.150786 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.150786 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.151069 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.151229 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.151377 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.151570 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.151723 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.151870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.152028 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.152175 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.152322 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.152468 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.152621 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.152768 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.152935 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.153082 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.153236 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.153383 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.153627 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.153779 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.153934 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.154081 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.154227 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.154373 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.154520 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.154665 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.154887 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.155043 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.155190 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.155372 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.155555 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.155730 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.155886 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.156033 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.156178 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.156324 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.156476 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.156631 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.156778 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.156946 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.157098 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.157293 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.157449 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.157605 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.157605 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.157894 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.158040 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.158186 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.158332 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.158486 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.158640 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.158787 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.158933 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.158933 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.159225 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.159373 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.159597 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.159750 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.159896 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.160051 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.160205 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.160352 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.160498 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.160643 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.160789 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.160935 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.161089 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.161249 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.161401 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.161566 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.161712 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.161859 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.162013 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.162160 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.162306 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.162459 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.162606 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.162764 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.162911 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.163057 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.163201 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.163362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.163554 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.163800 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.163954 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.164114 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.164261 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.164407 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.164559 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.164714 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.164868 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.165015 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.165160 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.165313 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.165466 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.165640 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.165794 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.165940 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.166087 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.166087 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.166376 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.166524 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.166670 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.166824 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.166970 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.167116 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.167310 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.167475 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.167658 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.167805 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.167965 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.168113 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.168268 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.168415 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.168561 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.168561 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.168853 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.169008 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.169163 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.169309 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.169466 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.169620 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.169767 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.169767 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.170053 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.170201 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.170354 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.170501 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.170646 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.170802 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.170948 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.171094 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.171252 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.171399 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.171617 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.171772 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.171919 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.172072 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.172225 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.172378 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.173058 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.173213 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.173367 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.173515 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.173672 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.173907 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.174070 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.174218 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.174373 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.174527 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.174673 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.174829 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.174975 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.175121 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.175266 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.175420 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.175590 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.175759 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.175907 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.175907 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.176199 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.176346 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.176535 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.176741 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.176891 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.177045 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.177191 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.177378 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.177542 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.177701 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.177848 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.177994 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.178139 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.178284 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.178438 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.178586 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.178749 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.178749 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.179028 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.179181 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.179335 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.179531 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.179709 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.179858 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.180003 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.180148 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.180302 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.180302 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.180648 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.180822 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.180969 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.181116 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.181307 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.181469 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.181617 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.181776 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.181776 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.182063 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.182265 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.182441 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.182591 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.182739 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.182911 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.183076 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.183225 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.183225 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.183530 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.183695 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.183844 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.184207 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.184405 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.184405 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.184751 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.184910 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.185068 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.185068 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.185426 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.185582 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.185729 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.185889 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.186050 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.186198 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.186345 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.186492 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.186492 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.186768 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.186924 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.187079 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.187226 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.187415 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.187609 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.187778 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.187926 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.188073 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.188271 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.188422 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.188568 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.188723 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.188870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.189024 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.189171 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.189317 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.189463 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.189617 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.189774 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.189774 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.190051 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.190198 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.190356 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.190510 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.190656 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.190802 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.190948 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.191094 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.191248 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.191396 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.191559 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.191725 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.191880 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.192027 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.192186 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.192341 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.192488 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.192635 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.192781 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.192940 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.193095 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.193241 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.193386 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.193543 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.193543 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.193837 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.193993 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.194227 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.194380 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.194535 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.194688 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.194847 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.194995 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.195142 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.195287 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.195434 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.195636 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.195801 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.195949 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.196358 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.196507 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.196653 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.196808 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.196955 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.197101 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.197247 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.197400 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.197596 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.197757 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.197924 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.198071 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.198217 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.198363 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.198510 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.198510 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.198803 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.198951 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.199104 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.199250 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.199403 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.199403 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.199704 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.199794 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.199893 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.199976 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.200065 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.200146 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.200232 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.200313 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.200391 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.200469 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.200563 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.200644 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.200731 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.200811 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.200977 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.201143 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.201305 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.201454 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.201600 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.201745 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.201891 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.202035 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.202189 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.202335 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.202480 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.202634 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.202793 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.202948 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.203095 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.203240 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.203393 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.203606 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.203781 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.203942 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.204090 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.204260 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.204492 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.204653 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.204825 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.204983 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.205130 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.205276 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.205429 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.205583 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.205737 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.205885 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.206031 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.206176 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.206322 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.206466 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.206620 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.206791 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.206941 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.207087 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.207233 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.207379 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.207563 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.207758 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.207905 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.208051 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.208197 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.208344 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.208502 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.208663 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.208818 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.208966 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.208966 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.209265 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.209413 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.209558 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.209711 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.209856 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.210003 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.210157 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.210304 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.210449 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.210605 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.210757 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.210903 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.211061 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.211208 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.211354 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.211522 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.211675 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.211898 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.212048 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.212194 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.212346 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.212492 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.212648 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.212803 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.212950 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.213096 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.213240 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.213387 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.213533 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.213688 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.213843 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.213990 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.214136 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.214283 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.214470 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.214631 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.214778 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.214924 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.215077 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.215224 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.215383 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.215567 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.215718 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.215865 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.216025 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.216173 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.216328 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.216486 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.216633 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.216779 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.216932 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.217080 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.217234 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.217388 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.217535 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.217722 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.217874 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.218021 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.218179 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.218345 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.218493 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.218639 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.218784 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.218939 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.219085 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.219231 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.219396 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.220122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.220274 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.220434 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.220594 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.220742 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.220899 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.221047 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.221192 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.221347 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.221500 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.221647 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.221792 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.221945 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.222100 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.222247 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.222393 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.222538 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.222695 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.222916 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.223072 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.223219 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.223364 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.223541 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.223706 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.223862 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.224019 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.224165 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.224310 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.224466 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.224613 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.224780 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.224927 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.225073 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.225073 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.225073 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.225487 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.225642 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.225790 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.225936 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.226082 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.226227 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.226373 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.226538 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.226685 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.226839 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.226986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.227132 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.227287 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.227447 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.227625 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.227861 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.228021 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.228176 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.228331 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.228479 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.228637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.228784 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.228931 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.229077 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.229235 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.229383 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.229528 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.229675 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.229820 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.229967 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.230122 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.230269 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.230425 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.230579 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.230733 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.230888 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.231036 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.231183 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.231329 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.231475 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.231703 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.231870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.232019 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.232165 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.232311 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.232475 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.232622 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.232781 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.232928 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.233076 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.233231 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.233377 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.233531 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.233678 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.233824 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.233971 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.234120 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.234276 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.234441 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.234441 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.234719 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.234866 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.235044 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.235275 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.235437 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.235616 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.235764 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.235911 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.236056 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.236204 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.236377 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.236526 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.236679 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.236679 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 03:21:00.236958 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.236958 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.236958 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.237376 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.237376 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.237651 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.237944 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.238255 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.238577 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.238885 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.239205 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.239547 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.239865 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.240174 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.240504 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.240814 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.241125 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.241437 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.241746 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.242059 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.242367 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.242693 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.243017 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.243323 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.243671 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.243990 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.244311 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.244624 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.244935 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.245263 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.245574 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.245883 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.246194 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.246504 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.246813 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.247129 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.247442 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.247780 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.248096 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.248411 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.248735 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.249059 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.249371 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.249693 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.250018 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.250361 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.251241 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.251668 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.252001 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.252323 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.252636 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.252944 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:21:00.253186 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 03:21:00.389747 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO dbcounter [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Registered counter for database nova_api Oct 04 03:21:00.407680 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO dbcounter [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] Registered counter for database nova_api Oct 04 03:21:00.410137 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_db.sqlalchemy.engines [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:21:00.416546 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG dbcounter [-] [105396] Writer thread running {{(pid=105396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:21:00.431243 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG oslo_db.sqlalchemy.engines [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105397) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:21:00.437807 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG dbcounter [-] [105397] Writer thread running {{(pid=105397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:21:00.473797 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.context [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c793cbfa-d3d2-4516-ac60-2697c5f19478(cell1) {{(pid=105396) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 03:21:00.477674 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:21:00.478189 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:21:00.479716 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:21:00.480421 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:21:00.480859 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:21:00.482822 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:21:00.484805 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO dbcounter [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Registered counter for database nova_cell0 Oct 04 03:21:00.489125 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO dbcounter [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Registered counter for database nova_cell1 Oct 04 03:21:00.496322 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_db.sqlalchemy.engines [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:21:00.497241 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.context [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c793cbfa-d3d2-4516-ac60-2697c5f19478(cell1) {{(pid=105397) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 03:21:00.497956 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_db.sqlalchemy.engines [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:21:00.502383 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG oslo_concurrency.lockutils [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105397) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:21:00.502873 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG oslo_concurrency.lockutils [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105397) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:21:00.504471 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG oslo_concurrency.lockutils [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105397) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:21:00.505206 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG oslo_concurrency.lockutils [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105397) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:21:00.505640 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG oslo_concurrency.lockutils [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105397) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:21:00.506747 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG dbcounter [-] [105396] Writer thread running {{(pid=105396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:21:00.507676 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG oslo_concurrency.lockutils [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105397) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:21:00.509687 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO dbcounter [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] Registered counter for database nova_cell0 Oct 04 03:21:00.510790 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG dbcounter [-] [105396] Writer thread running {{(pid=105396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:21:00.513780 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO dbcounter [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] Registered counter for database nova_cell1 Oct 04 03:21:00.522156 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG oslo_db.sqlalchemy.engines [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105397) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:21:00.523817 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG oslo_db.sqlalchemy.engines [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105397) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:21:00.529590 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG dbcounter [-] [105397] Writer thread running {{(pid=105397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:21:00.531789 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG dbcounter [-] [105397] Writer thread running {{(pid=105397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:21:00.654168 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO dbcounter [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Registered counter for database nova_cell0 Oct 04 03:21:00.663092 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_db.sqlalchemy.engines [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:21:00.667796 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG dbcounter [-] [105396] Writer thread running {{(pid=105396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:21:00.679844 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO dbcounter [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] Registered counter for database nova_cell0 Oct 04 03:21:00.689724 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG oslo_db.sqlalchemy.engines [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105397) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:21:00.694803 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG dbcounter [-] [105397] Writer thread running {{(pid=105397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:21:01.004002 dv-cinder-849143-9-smb devstack@n-api.service[105396]: WARNING keystonemiddleware.auth_token [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 03:21:01.011252 dv-cinder-849143-9-smb devstack@n-api.service[105397]: WARNING keystonemiddleware.auth_token [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 03:21:01.011719 dv-cinder-849143-9-smb devstack@n-api.service[105396]: WARNING keystonemiddleware.auth_token [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 03:21:01.018733 dv-cinder-849143-9-smb devstack@n-api.service[105397]: WARNING keystonemiddleware.auth_token [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 03:21:01.352004 dv-cinder-849143-9-smb devstack@n-api.service[105396]: WARNING keystonemiddleware.auth_token [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 03:21:01.357836 dv-cinder-849143-9-smb devstack@n-api.service[105396]: WARNING keystonemiddleware.auth_token [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 03:21:01.359682 dv-cinder-849143-9-smb devstack@n-api.service[105397]: WARNING keystonemiddleware.auth_token [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 03:21:01.363849 dv-cinder-849143-9-smb devstack@n-api.service[105396]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5566846429c0 pid: 105396 (default app) Oct 04 03:21:01.365918 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:21:01.366516 dv-cinder-849143-9-smb devstack@n-api.service[105397]: WARNING keystonemiddleware.auth_token [None req-e4abd277-773f-4b7f-9732-94ef1e28f1af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 03:21:01.367077 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Oct 04 03:21:01.367470 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Tue Oct 4 03:21:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:21:01.371756 dv-cinder-849143-9-smb devstack@n-api.service[105397]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5566846429c0 pid: 105397 (default app) Oct 04 03:22:23.499411 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:22:23.501231 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002800 Oct 04 03:22:23.501611 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Tue Oct 4 03:22:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:22:23.513482 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG dbcounter [-] [105397] Writing DB stats nova_api:SELECT=3 {{(pid=105397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:23.514287 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG dbcounter [-] [105397] Writing DB stats nova_cell0:SELECT=3 {{(pid=105397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:23.515253 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG dbcounter [-] [105397] Writing DB stats nova_cell1:SELECT=3 {{(pid=105397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:23.516233 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG dbcounter [-] [105397] Writing DB stats nova_cell0:SELECT=3 {{(pid=105397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:24.398219 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-df0d22d1-97a5-4a44-8d94-e5464d56dab5 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:22:24.431598 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-df0d22d1-97a5-4a44-8d94-e5464d56dab5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.923291 Oct 04 03:22:24.448064 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Oct 4 03:22:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:22:27.090304 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:22:27.091302 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-312d51c6-8183-4f03-b409-3d97f9d17a03 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 04 03:22:27.091905 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Tue Oct 4 03:22:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:22:27.555308 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-6c500165-2818-4f7b-9874-2d10d2ed9c37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:27.604421 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-6c500165-2818-4f7b-9874-2d10d2ed9c37 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.504920 Oct 04 03:22:27.604994 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Oct 4 03:22:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 03:22:27.619112 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG dbcounter [-] [105396] Writing DB stats nova_api:SELECT=3 {{(pid=105396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:27.619862 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG dbcounter [-] [105396] Writing DB stats nova_cell0:SELECT=3 {{(pid=105396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:27.621755 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG dbcounter [-] [105396] Writing DB stats nova_cell1:SELECT=3 {{(pid=105396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:27.622507 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG dbcounter [-] [105396] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:27.832399 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-1c7eb88b-b0a9-4406-8e32-a0ffd4cb7558 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:27.902818 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-1c7eb88b-b0a9-4406-8e32-a0ffd4cb7558 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288845 Oct 04 03:22:27.903705 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Oct 4 03:22:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:22:30.526522 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-6c500165-2818-4f7b-9874-2d10d2ed9c37 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:22:30.528185 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-6c500165-2818-4f7b-9874-2d10d2ed9c37 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Oct 04 03:22:30.528574 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Tue Oct 4 03:22:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:22:31.186624 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-5df37169-107c-4723-94f0-ad253b3ab997 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "ram": 512, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M"}} {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:31.225279 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-5df37169-107c-4723-94f0-ad253b3ab997 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.689962 Oct 04 03:22:31.225811 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Oct 4 03:22:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:22:31.237849 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-d862794b-0f87-44db-b4d3-80eb9d291b94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:31.278717 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-d862794b-0f87-44db-b4d3-80eb9d291b94 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044387 Oct 04 03:22:31.279531 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Oct 4 03:22:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:22:33.876474 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-5df37169-107c-4723-94f0-ad253b3ab997 admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:22:33.877788 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-5df37169-107c-4723-94f0-ad253b3ab997 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 Oct 04 03:22:33.878231 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Tue Oct 4 03:22:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:22:34.304107 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-57dfe2ab-dca0-4506-b092-d656e4967a2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "disk": 10, "swap": 0, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:34.323992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-57dfe2ab-dca0-4506-b092-d656e4967a2b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439144 Oct 04 03:22:34.324717 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Oct 4 03:22:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 03:22:34.337159 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-87d10a15-1c68-400c-be38-6a04bc5647ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:34.364199 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-87d10a15-1c68-400c-be38-6a04bc5647ec admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030655 Oct 04 03:22:34.364767 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Oct 4 03:22:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:22:37.057844 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-57dfe2ab-dca0-4506-b092-d656e4967a2b admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:22:37.059758 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-57dfe2ab-dca0-4506-b092-d656e4967a2b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002132 Oct 04 03:22:37.060475 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Tue Oct 4 03:22:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:22:37.498144 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-90126c6c-b42e-4fde-8b46-fbb25e595db8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048}} {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:37.518974 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-90126c6c-b42e-4fde-8b46-fbb25e595db8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.451981 Oct 04 03:22:37.519689 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Oct 4 03:22:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 03:22:37.532515 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-346a22da-bdbd-440c-b6d0-adfccc9e47d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:37.562502 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-346a22da-bdbd-440c-b6d0-adfccc9e47d3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034230 Oct 04 03:22:37.563387 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Oct 4 03:22:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:22:40.340574 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-90126c6c-b42e-4fde-8b46-fbb25e595db8 admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:22:40.342022 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-90126c6c-b42e-4fde-8b46-fbb25e595db8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002249 Oct 04 03:22:40.342634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Tue Oct 4 03:22:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:22:40.826572 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-e8441e18-b09e-493a-b9ec-9a34ae9bbc92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:40.847506 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-e8441e18-b09e-493a-b9ec-9a34ae9bbc92 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496235 Oct 04 03:22:40.848087 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Oct 4 03:22:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:22:40.860513 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-f45f2d9c-0c46-43cf-9782-3bb97621489c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:40.889021 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-f45f2d9c-0c46-43cf-9782-3bb97621489c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031995 Oct 04 03:22:40.890402 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Oct 4 03:22:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:22:43.562095 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-e8441e18-b09e-493a-b9ec-9a34ae9bbc92 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:22:43.563191 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-e8441e18-b09e-493a-b9ec-9a34ae9bbc92 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002102 Oct 04 03:22:43.563604 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Tue Oct 4 03:22:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:22:44.025762 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-98f8de3c-63cc-478c-8596-5f778e5d85f5 admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:22:44.058946 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-98f8de3c-63cc-478c-8596-5f778e5d85f5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.488797 Oct 04 03:22:44.059661 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Oct 4 03:22:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:22:46.812045 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-e8441e18-b09e-493a-b9ec-9a34ae9bbc92 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:22:46.813124 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-e8441e18-b09e-493a-b9ec-9a34ae9bbc92 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Oct 04 03:22:46.813590 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Tue Oct 4 03:22:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:22:47.212274 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-b393cd81-d085-433e-b8aa-fcdfd499f4d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "name": "m1.tiny", "ram": 512, "id": "1", "vcpus": 1}} {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:47.234814 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-b393cd81-d085-433e-b8aa-fcdfd499f4d5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.414912 Oct 04 03:22:47.235358 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Oct 4 03:22:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:22:47.247242 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-828f8551-24cc-4e81-8383-3bd7ecd28836 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:47.275476 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-828f8551-24cc-4e81-8383-3bd7ecd28836 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031795 Oct 04 03:22:47.276207 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Oct 4 03:22:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:22:49.907444 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-b393cd81-d085-433e-b8aa-fcdfd499f4d5 admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:22:49.908527 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-b393cd81-d085-433e-b8aa-fcdfd499f4d5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 04 03:22:49.908918 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Tue Oct 4 03:22:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:22:50.292460 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-df065437-7a54-4097-a3d4-c5074bfaa953 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "swap": 0, "id": "2", "rxtx_factor": 1.0}} {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:50.312084 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-df065437-7a54-4097-a3d4-c5074bfaa953 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.397094 Oct 04 03:22:50.312662 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Oct 4 03:22:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:22:50.324783 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-b5fc0332-fac8-4e2b-8d5a-96ee56e8726f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:50.350076 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-b5fc0332-fac8-4e2b-8d5a-96ee56e8726f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028614 Oct 04 03:22:50.350583 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Oct 4 03:22:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:22:52.984293 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-df065437-7a54-4097-a3d4-c5074bfaa953 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:22:52.985397 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-df065437-7a54-4097-a3d4-c5074bfaa953 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 04 03:22:52.985868 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Tue Oct 4 03:22:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:22:53.490120 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-45ebc8e4-dd8f-4023-82b8-0f4bf367bed1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "vcpus": 2}} {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:53.512571 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-45ebc8e4-dd8f-4023-82b8-0f4bf367bed1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.520297 Oct 04 03:22:53.513123 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Oct 4 03:22:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:22:53.526381 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-0bba5632-86c4-4d92-8aaf-ad1514854355 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:53.552325 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-0bba5632-86c4-4d92-8aaf-ad1514854355 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030015 Oct 04 03:22:53.552989 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Oct 4 03:22:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:22:56.209322 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-45ebc8e4-dd8f-4023-82b8-0f4bf367bed1 admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:22:56.211087 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-45ebc8e4-dd8f-4023-82b8-0f4bf367bed1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002281 Oct 04 03:22:56.211600 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Tue Oct 4 03:22:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:22:56.657961 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-9cbc18a2-a199-4457-81d9-e1bd87281c7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "disk": 80, "name": "m1.large"}} {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:56.665266 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG dbcounter [-] [105397] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:56.679153 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-9cbc18a2-a199-4457-81d9-e1bd87281c7d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460247 Oct 04 03:22:56.679738 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Oct 4 03:22:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:22:56.692476 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-80d568b8-d703-4bea-a45d-c5f8bfca4491 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:56.719044 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-80d568b8-d703-4bea-a45d-c5f8bfca4491 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030164 Oct 04 03:22:56.720110 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Oct 4 03:22:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:22:59.409784 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-9cbc18a2-a199-4457-81d9-e1bd87281c7d admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:22:59.411519 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-9cbc18a2-a199-4457-81d9-e1bd87281c7d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002168 Oct 04 03:22:59.412466 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Tue Oct 4 03:22:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:22:59.982868 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-f3338bff-2460-49a5-9540-3a94dace3232 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "id": "5"}} {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:22:59.990320 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG dbcounter [-] [105396] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:00.008287 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-f3338bff-2460-49a5-9540-3a94dace3232 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.590016 Oct 04 03:23:00.009362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Oct 4 03:22:59 2022] POST /compute/v2.1/flavors => generated 408 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:23:00.021899 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-c8f589d1-069d-4619-bbf5-a06c72f0d2ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:23:00.050777 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-c8f589d1-069d-4619-bbf5-a06c72f0d2ff admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032784 Oct 04 03:23:00.051767 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Oct 4 03:23:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:23:16.751624 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-f3338bff-2460-49a5-9540-3a94dace3232 admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:16.752633 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-f3338bff-2460-49a5-9540-3a94dace3232 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 04 03:23:16.753029 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Tue Oct 4 03:23:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:23:16.763473 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG dbcounter [-] [105397] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:17.139784 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-ffb680f9-595c-4558-8ba9-7e8a6a8ecd67 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:17.161406 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-ffb680f9-595c-4558-8ba9-7e8a6a8ecd67 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402262 Oct 04 03:23:17.161862 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Oct 4 03:23:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:23:18.466926 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-f3338bff-2460-49a5-9540-3a94dace3232 admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:18.467935 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-f3338bff-2460-49a5-9540-3a94dace3232 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002041 Oct 04 03:23:18.468328 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Oct 4 03:23:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:23:18.996213 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-974068fd-6ee9-45ea-8657-33ca0c28349b admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:19.002089 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.wsgi [None req-974068fd-6ee9-45ea-8657-33ca0c28349b admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-974068fd-6ee9-45ea-8657-33ca0c28349b admin admin] Request method failure captured: Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Accept: application/json Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Accept-Encoding: gzip, deflate Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Connection: keep-alive Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Content-Length: 0 Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Host: 10.222.0.25 Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Openstack-Api-Version: compute 2.92 Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Openstack-System-Scope: None Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: User-Agent: python-novaclient Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Auth-Token: gAAAAABjO6cmZC82E8jqu_TBssZa890R6ASd5ksm13DG3sIZUrx01LWxRvOhpFcgSPZFDxXnW9B4jBzNsiJjFCmD654G91X7fYCES23WYJ6FTo5T4gBlur34KBO171zr3qqxePKPlUz5WcLnRJpKbgV3SUYOaUcQdW_ryIRLwAduoym89J5N4To Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Domain-Id: None Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Domain-Name: None Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Identity-Status: Confirmed Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Is-Admin-Project: True Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Project-Domain-Id: default Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Project-Domain-Name: Default Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Project-Id: 1f0f8d5c867d4d0e8de6fcf13db59693 Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Project-Name: admin Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Role: reader,admin,member Oct 04 03:23:19.005350 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Roles: reader,admin,member Oct 04 03:23:19.006986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f0f8d5c867d4d0e8de6fcf13db59693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f0f8d5c867d4d0e8de6fcf13db59693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f0f8d5c867d4d0e8de6fcf13db59693", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f0f8d5c867d4d0e8de6fcf13db59693"}]}] Oct 04 03:23:19.006986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Tenant: admin Oct 04 03:23:19.006986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Tenant-Id: 1f0f8d5c867d4d0e8de6fcf13db59693 Oct 04 03:23:19.006986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Tenant-Name: admin Oct 04 03:23:19.006986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User: admin Oct 04 03:23:19.006986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User-Domain-Id: default Oct 04 03:23:19.006986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User-Domain-Name: Default Oct 04 03:23:19.006986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User-Id: 7c1281e81e9c4e3da30715cc2f1b3156 Oct 04 03:23:19.006986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User-Name: admin Oct 04 03:23:19.006986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: method: > Oct 04 03:23:19.006986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: exception: Flavor 42 could not be found. Oct 04 03:23:19.006986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: action_args: {'id': '42'} Oct 04 03:23:19.006986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:23:19.006986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:23:19.007992 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:19.009150 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-974068fd-6ee9-45ea-8657-33ca0c28349b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105397) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:23:19.010247 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-974068fd-6ee9-45ea-8657-33ca0c28349b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389897 Oct 04 03:23:19.010247 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Oct 4 03:23:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:19.017489 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-2aac3ffc-8809-44b4-9c9d-c8cf67e5cd9d admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:19.039933 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-2aac3ffc-8809-44b4-9c9d-c8cf67e5cd9d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026850 Oct 04 03:23:19.040678 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Oct 4 03:23:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:23:19.052143 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-01c02672-1532-49bb-8e63-11a1d1b6daae admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:19.074740 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-01c02672-1532-49bb-8e63-11a1d1b6daae admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027474 Oct 04 03:23:19.075876 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Oct 4 03:23:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:23:19.085403 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-7188ad6a-a4ef-4b9c-9855-dfd58d0388de admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:19.090855 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.wsgi [None req-7188ad6a-a4ef-4b9c-9855-dfd58d0388de admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-7188ad6a-a4ef-4b9c-9855-dfd58d0388de admin admin] Request method failure captured: Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Accept: application/json Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Accept-Encoding: gzip, deflate Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Connection: keep-alive Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Content-Length: 0 Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Host: 10.222.0.25 Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Openstack-Api-Version: compute 2.92 Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Openstack-System-Scope: None Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: User-Agent: python-novaclient Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Auth-Token: gAAAAABjO6cmZC82E8jqu_TBssZa890R6ASd5ksm13DG3sIZUrx01LWxRvOhpFcgSPZFDxXnW9B4jBzNsiJjFCmD654G91X7fYCES23WYJ6FTo5T4gBlur34KBO171zr3qqxePKPlUz5WcLnRJpKbgV3SUYOaUcQdW_ryIRLwAduoym89J5N4To Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Domain-Id: None Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Domain-Name: None Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Identity-Status: Confirmed Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Is-Admin-Project: True Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Project-Domain-Id: default Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Project-Domain-Name: Default Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Project-Id: 1f0f8d5c867d4d0e8de6fcf13db59693 Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Project-Name: admin Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Role: reader,admin,member Oct 04 03:23:19.094122 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Roles: reader,admin,member Oct 04 03:23:19.095669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f0f8d5c867d4d0e8de6fcf13db59693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f0f8d5c867d4d0e8de6fcf13db59693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f0f8d5c867d4d0e8de6fcf13db59693", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f0f8d5c867d4d0e8de6fcf13db59693"}]}] Oct 04 03:23:19.095669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Tenant: admin Oct 04 03:23:19.095669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Tenant-Id: 1f0f8d5c867d4d0e8de6fcf13db59693 Oct 04 03:23:19.095669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Tenant-Name: admin Oct 04 03:23:19.095669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User: admin Oct 04 03:23:19.095669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User-Domain-Id: default Oct 04 03:23:19.095669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User-Domain-Name: Default Oct 04 03:23:19.095669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User-Id: 7c1281e81e9c4e3da30715cc2f1b3156 Oct 04 03:23:19.095669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User-Name: admin Oct 04 03:23:19.095669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: method: > Oct 04 03:23:19.095669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: exception: Flavor 42 could not be found. Oct 04 03:23:19.095669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: action_args: {'id': '42'} Oct 04 03:23:19.095669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:23:19.095669 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:23:19.097572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:19.098892 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-7188ad6a-a4ef-4b9c-9855-dfd58d0388de admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:23:19.100160 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-7188ad6a-a4ef-4b9c-9855-dfd58d0388de admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013691 Oct 04 03:23:19.100160 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Oct 4 03:23:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 03:23:20.301052 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-01c02672-1532-49bb-8e63-11a1d1b6daae admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:20.302053 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-01c02672-1532-49bb-8e63-11a1d1b6daae admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 04 03:23:20.302448 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Oct 4 03:23:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:23:20.852720 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-49b28dda-a32c-45b3-be2d-9bf4d40cb663 admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:20.858859 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.wsgi [None req-49b28dda-a32c-45b3-be2d-9bf4d40cb663 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-49b28dda-a32c-45b3-be2d-9bf4d40cb663 admin admin] Request method failure captured: Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Accept: application/json Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Accept-Encoding: gzip, deflate Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Connection: keep-alive Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Content-Length: 0 Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Host: 10.222.0.25 Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Openstack-Api-Version: compute 2.92 Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Openstack-System-Scope: None Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: User-Agent: python-novaclient Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Auth-Token: gAAAAABjO6coOll_iKQ7eWoYXddqTlrN5FPxi1XvqUVaMgyknZIHqv_in2V7Fla6N-MNPfZM94eT2C-WSK-nknbRdKyZ2YA0KbkqIT3YPPNVcy78ad872yR_IfSgYA2bCkFtFbhsZljLN7gWiolQ6U2LoAmdpnRBw6ePStU3z_i8V_ZlrtoXLA8 Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Domain-Id: None Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Domain-Name: None Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Identity-Status: Confirmed Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Is-Admin-Project: True Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Project-Domain-Id: default Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Project-Domain-Name: Default Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Project-Id: 1f0f8d5c867d4d0e8de6fcf13db59693 Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Project-Name: admin Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Role: reader,admin,member Oct 04 03:23:20.860390 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Roles: reader,admin,member Oct 04 03:23:20.861871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f0f8d5c867d4d0e8de6fcf13db59693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f0f8d5c867d4d0e8de6fcf13db59693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f0f8d5c867d4d0e8de6fcf13db59693", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f0f8d5c867d4d0e8de6fcf13db59693"}]}] Oct 04 03:23:20.861871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Tenant: admin Oct 04 03:23:20.861871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Tenant-Id: 1f0f8d5c867d4d0e8de6fcf13db59693 Oct 04 03:23:20.861871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Tenant-Name: admin Oct 04 03:23:20.861871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User: admin Oct 04 03:23:20.861871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User-Domain-Id: default Oct 04 03:23:20.861871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User-Domain-Name: Default Oct 04 03:23:20.861871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User-Id: 7c1281e81e9c4e3da30715cc2f1b3156 Oct 04 03:23:20.861871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User-Name: admin Oct 04 03:23:20.861871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: method: > Oct 04 03:23:20.861871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: exception: Flavor 84 could not be found. Oct 04 03:23:20.861871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: action_args: {'id': '84'} Oct 04 03:23:20.861871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:23:20.861871 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:23:20.862812 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:20.864359 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-49b28dda-a32c-45b3-be2d-9bf4d40cb663 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:23:20.865573 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-49b28dda-a32c-45b3-be2d-9bf4d40cb663 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.416242 Oct 04 03:23:20.865573 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Oct 4 03:23:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:20.871625 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-7673a2ca-6c69-4d40-a919-adac79007743 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:20.886941 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-7673a2ca-6c69-4d40-a919-adac79007743 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018804 Oct 04 03:23:20.887588 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Oct 4 03:23:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:23:20.896975 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-d534e783-968c-4c91-8cdb-d761a1470fec admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:20.915969 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-d534e783-968c-4c91-8cdb-d761a1470fec admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022378 Oct 04 03:23:20.916509 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Oct 4 03:23:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:23:20.926406 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-4ce24bd7-09d1-40f4-8a2f-b19d044d64fb admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:20.931413 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.wsgi [None req-4ce24bd7-09d1-40f4-8a2f-b19d044d64fb admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-4ce24bd7-09d1-40f4-8a2f-b19d044d64fb admin admin] Request method failure captured: Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Accept: application/json Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Accept-Encoding: gzip, deflate Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Connection: keep-alive Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Content-Length: 0 Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Host: 10.222.0.25 Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Openstack-Api-Version: compute 2.92 Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Openstack-System-Scope: None Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: User-Agent: python-novaclient Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Auth-Token: gAAAAABjO6coOll_iKQ7eWoYXddqTlrN5FPxi1XvqUVaMgyknZIHqv_in2V7Fla6N-MNPfZM94eT2C-WSK-nknbRdKyZ2YA0KbkqIT3YPPNVcy78ad872yR_IfSgYA2bCkFtFbhsZljLN7gWiolQ6U2LoAmdpnRBw6ePStU3z_i8V_ZlrtoXLA8 Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Domain-Id: None Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Domain-Name: None Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Identity-Status: Confirmed Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Is-Admin-Project: True Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Project-Domain-Id: default Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Project-Domain-Name: Default Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Project-Id: 1f0f8d5c867d4d0e8de6fcf13db59693 Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Project-Name: admin Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Role: reader,admin,member Oct 04 03:23:20.932943 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Roles: reader,admin,member Oct 04 03:23:20.935030 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f0f8d5c867d4d0e8de6fcf13db59693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f0f8d5c867d4d0e8de6fcf13db59693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f0f8d5c867d4d0e8de6fcf13db59693", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f0f8d5c867d4d0e8de6fcf13db59693"}]}] Oct 04 03:23:20.935030 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Tenant: admin Oct 04 03:23:20.935030 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Tenant-Id: 1f0f8d5c867d4d0e8de6fcf13db59693 Oct 04 03:23:20.935030 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Tenant-Name: admin Oct 04 03:23:20.935030 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User: admin Oct 04 03:23:20.935030 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User-Domain-Id: default Oct 04 03:23:20.935030 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User-Domain-Name: Default Oct 04 03:23:20.935030 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User-Id: 7c1281e81e9c4e3da30715cc2f1b3156 Oct 04 03:23:20.935030 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User-Name: admin Oct 04 03:23:20.935030 dv-cinder-849143-9-smb devstack@n-api.service[105397]: method: > Oct 04 03:23:20.935030 dv-cinder-849143-9-smb devstack@n-api.service[105397]: exception: Flavor 84 could not be found. Oct 04 03:23:20.935030 dv-cinder-849143-9-smb devstack@n-api.service[105397]: action_args: {'id': '84'} Oct 04 03:23:20.935030 dv-cinder-849143-9-smb devstack@n-api.service[105397]: {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:23:20.935030 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:23:20.935986 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:20.937299 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-4ce24bd7-09d1-40f4-8a2f-b19d044d64fb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105397) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:23:20.938632 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-4ce24bd7-09d1-40f4-8a2f-b19d044d64fb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011482 Oct 04 03:23:20.938632 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Oct 4 03:23:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 03:23:22.275062 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-d534e783-968c-4c91-8cdb-d761a1470fec admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:22.276105 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-d534e783-968c-4c91-8cdb-d761a1470fec admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 04 03:23:22.276501 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Oct 4 03:23:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:23:22.808469 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-4ceee68a-36ef-461f-97d6-ecca4deaa49c admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:22.815062 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.wsgi [None req-4ceee68a-36ef-461f-97d6-ecca4deaa49c admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-4ceee68a-36ef-461f-97d6-ecca4deaa49c admin admin] Request method failure captured: Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Accept: application/json Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Accept-Encoding: gzip, deflate Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Connection: keep-alive Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Content-Length: 0 Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Host: 10.222.0.25 Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Openstack-Api-Version: compute 2.92 Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Openstack-System-Scope: None Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: User-Agent: python-novaclient Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Auth-Token: gAAAAABjO6cq8EuBh9t6zGEqJy8LHKXSGic2xeECL2F7Lx4ZN0MZouP4J7ZfqR-9vpzKYrsF3VDkpsdlIn4DCVUxfcirAgUUl4_gfsPHTMUsx6108r_3UO2X4dEVCi5JKXxvVkl6hKYYp_4NoTOVP3lSelFQDUYJfPjZYhBAIJBcz5r3zOBaWs4 Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Domain-Id: None Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Domain-Name: None Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Identity-Status: Confirmed Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Is-Admin-Project: True Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Project-Domain-Id: default Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Project-Domain-Name: Default Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Project-Id: 1f0f8d5c867d4d0e8de6fcf13db59693 Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Project-Name: admin Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Role: reader,admin,member Oct 04 03:23:22.816637 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Roles: reader,admin,member Oct 04 03:23:22.818152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f0f8d5c867d4d0e8de6fcf13db59693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f0f8d5c867d4d0e8de6fcf13db59693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f0f8d5c867d4d0e8de6fcf13db59693", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f0f8d5c867d4d0e8de6fcf13db59693"}]}] Oct 04 03:23:22.818152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Tenant: admin Oct 04 03:23:22.818152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Tenant-Id: 1f0f8d5c867d4d0e8de6fcf13db59693 Oct 04 03:23:22.818152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-Tenant-Name: admin Oct 04 03:23:22.818152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User: admin Oct 04 03:23:22.818152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User-Domain-Id: default Oct 04 03:23:22.818152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User-Domain-Name: Default Oct 04 03:23:22.818152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User-Id: 7c1281e81e9c4e3da30715cc2f1b3156 Oct 04 03:23:22.818152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: X-User-Name: admin Oct 04 03:23:22.818152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: method: > Oct 04 03:23:22.818152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: exception: Flavor 451 could not be found. Oct 04 03:23:22.818152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: action_args: {'id': '451'} Oct 04 03:23:22.818152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:23:22.818152 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:23:22.819031 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: ERROR nova.api.openstack.wsgi Oct 04 03:23:22.820104 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-4ceee68a-36ef-461f-97d6-ecca4deaa49c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105397) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:23:22.821147 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-4ceee68a-36ef-461f-97d6-ecca4deaa49c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.398927 Oct 04 03:23:22.821147 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Oct 4 03:23:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:22.828607 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-f8298798-b32c-46e8-8a17-a1d75199b45e admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:22.843602 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-f8298798-b32c-46e8-8a17-a1d75199b45e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019090 Oct 04 03:23:22.844119 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Oct 4 03:23:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:23:22.853496 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-11cc6141-972f-490d-ae58-fc0819b7d131 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:22.868240 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-11cc6141-972f-490d-ae58-fc0819b7d131 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018434 Oct 04 03:23:22.868785 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Oct 4 03:23:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:23:22.878443 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-d7afec53-3f23-45df-a19e-9799f5299f8b admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:22.883343 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.wsgi [None req-d7afec53-3f23-45df-a19e-9799f5299f8b admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-d7afec53-3f23-45df-a19e-9799f5299f8b admin admin] Request method failure captured: Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Accept: application/json Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Accept-Encoding: gzip, deflate Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Connection: keep-alive Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Content-Length: 0 Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Host: 10.222.0.25 Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Openstack-Api-Version: compute 2.92 Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Openstack-System-Scope: None Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: User-Agent: python-novaclient Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Auth-Token: gAAAAABjO6cq8EuBh9t6zGEqJy8LHKXSGic2xeECL2F7Lx4ZN0MZouP4J7ZfqR-9vpzKYrsF3VDkpsdlIn4DCVUxfcirAgUUl4_gfsPHTMUsx6108r_3UO2X4dEVCi5JKXxvVkl6hKYYp_4NoTOVP3lSelFQDUYJfPjZYhBAIJBcz5r3zOBaWs4 Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Domain-Id: None Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Domain-Name: None Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Identity-Status: Confirmed Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Is-Admin-Project: True Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Project-Domain-Id: default Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Project-Domain-Name: Default Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Project-Id: 1f0f8d5c867d4d0e8de6fcf13db59693 Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Project-Name: admin Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Role: reader,admin,member Oct 04 03:23:22.884870 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Roles: reader,admin,member Oct 04 03:23:22.886432 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f0f8d5c867d4d0e8de6fcf13db59693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f0f8d5c867d4d0e8de6fcf13db59693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f0f8d5c867d4d0e8de6fcf13db59693", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f0f8d5c867d4d0e8de6fcf13db59693"}]}] Oct 04 03:23:22.886432 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Tenant: admin Oct 04 03:23:22.886432 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Tenant-Id: 1f0f8d5c867d4d0e8de6fcf13db59693 Oct 04 03:23:22.886432 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-Tenant-Name: admin Oct 04 03:23:22.886432 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User: admin Oct 04 03:23:22.886432 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User-Domain-Id: default Oct 04 03:23:22.886432 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User-Domain-Name: Default Oct 04 03:23:22.886432 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User-Id: 7c1281e81e9c4e3da30715cc2f1b3156 Oct 04 03:23:22.886432 dv-cinder-849143-9-smb devstack@n-api.service[105396]: X-User-Name: admin Oct 04 03:23:22.886432 dv-cinder-849143-9-smb devstack@n-api.service[105396]: method: > Oct 04 03:23:22.886432 dv-cinder-849143-9-smb devstack@n-api.service[105396]: exception: Flavor 451 could not be found. Oct 04 03:23:22.886432 dv-cinder-849143-9-smb devstack@n-api.service[105396]: action_args: {'id': '451'} Oct 04 03:23:22.886432 dv-cinder-849143-9-smb devstack@n-api.service[105396]: {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:23:22.886432 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:23:22.887362 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: ERROR nova.api.openstack.wsgi Oct 04 03:23:22.888634 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-d7afec53-3f23-45df-a19e-9799f5299f8b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:23:22.889823 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-d7afec53-3f23-45df-a19e-9799f5299f8b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011257 Oct 04 03:23:22.889823 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Oct 4 03:23:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 03:23:24.098036 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-11cc6141-972f-490d-ae58-fc0819b7d131 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:24.099051 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-11cc6141-972f-490d-ae58-fc0819b7d131 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 04 03:23:24.099448 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Oct 4 03:23:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:23:24.622758 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-6b58422a-53be-41a9-a013-0873178a2185 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:23:24.642456 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-6b58422a-53be-41a9-a013-0873178a2185 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.404556 Oct 04 03:23:24.643018 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Oct 4 03:23:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:23:25.883794 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-11cc6141-972f-490d-ae58-fc0819b7d131 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:25.884807 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-11cc6141-972f-490d-ae58-fc0819b7d131 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 04 03:23:25.885242 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Oct 4 03:23:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:23:26.403333 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-9ece4615-b5c1-41ec-af2a-7e164adc8f27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:23:26.421543 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-9ece4615-b5c1-41ec-af2a-7e164adc8f27 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.399168 Oct 04 03:23:26.422082 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Oct 4 03:23:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:23:27.640388 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-11cc6141-972f-490d-ae58-fc0819b7d131 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:27.641394 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-11cc6141-972f-490d-ae58-fc0819b7d131 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 04 03:23:27.641787 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Oct 4 03:23:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:23:28.158967 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-91fe2bb6-f490-42d8-ae29-247423ce7fd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:23:28.178690 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-91fe2bb6-f490-42d8-ae29-247423ce7fd5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.400709 Oct 04 03:23:28.179232 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Oct 4 03:23:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:23:29.396178 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-11cc6141-972f-490d-ae58-fc0819b7d131 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:29.397203 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-11cc6141-972f-490d-ae58-fc0819b7d131 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 04 03:23:29.397591 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Oct 4 03:23:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:23:29.926580 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-76061155-d634-4c1a-8900-94468a5df594 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:23:29.944533 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-76061155-d634-4c1a-8900-94468a5df594 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.406579 Oct 04 03:23:29.945065 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Oct 4 03:23:29 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:23:31.186913 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-11cc6141-972f-490d-ae58-fc0819b7d131 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:31.187939 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-11cc6141-972f-490d-ae58-fc0819b7d131 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 04 03:23:31.188328 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Oct 4 03:23:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:23:31.719206 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-2cf203b5-955c-48e6-854e-67fe302493df admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:23:31.743024 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-2cf203b5-955c-48e6-854e-67fe302493df admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.416001 Oct 04 03:23:31.743516 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Tue Oct 4 03:23:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:24:28.603640 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-11cc6141-972f-490d-ae58-fc0819b7d131 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:24:28.604630 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-11cc6141-972f-490d-ae58-fc0819b7d131 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001988 Oct 04 03:24:28.605026 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Tue Oct 4 03:24:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:24:28.615375 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG dbcounter [-] [105396] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:29.011678 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-091e85ea-241c-45f0-b7a1-ef641dde1b59 admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:24:29.032229 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-091e85ea-241c-45f0-b7a1-ef641dde1b59 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.421417 Oct 04 03:24:29.032759 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Oct 4 03:24:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:24:29.054015 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG dbcounter [-] [105397] Writing DB stats nova_api:SELECT=14 {{(pid=105397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:29.058045 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-5dacaa36-b2db-42c3-b89b-e91dbed3cb92 admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:24:29.065452 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-5dacaa36-b2db-42c3-b89b-e91dbed3cb92 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012964 Oct 04 03:24:29.065973 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Tue Oct 4 03:24:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:24:29.078315 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-98820db1-0eaa-4c39-b820-1cf9b5b92bfe admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:24:29.085457 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-98820db1-0eaa-4c39-b820-1cf9b5b92bfe admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010692 Oct 04 03:24:29.085956 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Tue Oct 4 03:24:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:24:29.097446 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-5a54dae4-37f6-4254-b7a4-fe754a3fb77c admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:24:29.104796 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-5a54dae4-37f6-4254-b7a4-fe754a3fb77c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010801 Oct 04 03:24:29.105355 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Tue Oct 4 03:24:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:24:29.116299 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-321202c9-ea4d-4f32-9617-f75161bab84f admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:24:29.123542 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-321202c9-ea4d-4f32-9617-f75161bab84f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010657 Oct 04 03:24:29.124040 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Tue Oct 4 03:24:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:27:28.093094 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-5a54dae4-37f6-4254-b7a4-fe754a3fb77c admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:27:28.094105 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-5a54dae4-37f6-4254-b7a4-fe754a3fb77c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 04 03:27:28.094502 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Oct 4 03:27:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:27:28.239702 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG dbcounter [-] [105396] Writing DB stats nova_api:SELECT=6 {{(pid=105396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:27:28.402829 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-e4f48b94-5cb4-4caf-8f04-6e869ff36c33 admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:27:28.409767 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-e4f48b94-5cb4-4caf-8f04-6e869ff36c33 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:27:28.410245 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-e4f48b94-5cb4-4caf-8f04-6e869ff36c33 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:27:28.410675 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-e4f48b94-5cb4-4caf-8f04-6e869ff36c33 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:27:28.411397 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-e4f48b94-5cb4-4caf-8f04-6e869ff36c33 admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:27:28.412145 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-e4f48b94-5cb4-4caf-8f04-6e869ff36c33 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:27:28.412804 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-e4f48b94-5cb4-4caf-8f04-6e869ff36c33 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:27:28.447626 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-e4f48b94-5cb4-4caf-8f04-6e869ff36c33 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.209058 Oct 04 03:27:28.448181 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Oct 4 03:27:28 2022] GET /compute/v2.1/os-services => generated 785 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:27:29.529448 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-5a54dae4-37f6-4254-b7a4-fe754a3fb77c admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:27:29.530435 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-5a54dae4-37f6-4254-b7a4-fe754a3fb77c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Oct 04 03:27:29.530829 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Oct 4 03:27:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:27:29.721572 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-ccb9ee46-88cb-4578-a361-de137e8a4caa admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:27:29.724968 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-ccb9ee46-88cb-4578-a361-de137e8a4caa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:27:29.725626 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-ccb9ee46-88cb-4578-a361-de137e8a4caa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:27:29.726299 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-ccb9ee46-88cb-4578-a361-de137e8a4caa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:27:29.727036 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-ccb9ee46-88cb-4578-a361-de137e8a4caa admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:27:29.727477 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-ccb9ee46-88cb-4578-a361-de137e8a4caa admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:27:29.727911 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-ccb9ee46-88cb-4578-a361-de137e8a4caa admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:27:29.746778 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-ccb9ee46-88cb-4578-a361-de137e8a4caa admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.075922 Oct 04 03:27:29.747304 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Oct 4 03:27:29 2022] GET /compute/v2.1/os-services => generated 785 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:27:41.254550 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-5a54dae4-37f6-4254-b7a4-fe754a3fb77c admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:27:41.255585 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-5a54dae4-37f6-4254-b7a4-fe754a3fb77c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 04 03:27:41.255978 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Oct 4 03:27:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:27:41.401799 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG dbcounter [-] [105396] Writing DB stats nova_cell0:SELECT=4 {{(pid=105396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:27:41.402506 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG dbcounter [-] [105396] Writing DB stats nova_cell1:SELECT=4 {{(pid=105396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:27:41.403131 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG dbcounter [-] [105396] Writing DB stats nova_api:SELECT=8 {{(pid=105396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:27:41.451303 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-05193de8-46a4-47d6-98ef-45230c1ef278 admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:27:41.454698 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-05193de8-46a4-47d6-98ef-45230c1ef278 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:27:41.455205 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-05193de8-46a4-47d6-98ef-45230c1ef278 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:27:41.455664 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-05193de8-46a4-47d6-98ef-45230c1ef278 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:27:41.456384 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-05193de8-46a4-47d6-98ef-45230c1ef278 admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:27:41.456833 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-05193de8-46a4-47d6-98ef-45230c1ef278 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:27:41.457253 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-05193de8-46a4-47d6-98ef-45230c1ef278 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:27:41.482993 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-05193de8-46a4-47d6-98ef-45230c1ef278 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1029 microversion: 2.92 time: 0.086475 Oct 04 03:27:41.483548 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Oct 4 03:27:41 2022] GET /compute/v2.1/os-services => generated 1029 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:27:42.558375 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG nova.api.openstack.wsgi [None req-5a54dae4-37f6-4254-b7a4-fe754a3fb77c admin admin] Calling method '>' {{(pid=105397) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:27:42.559365 dv-cinder-849143-9-smb devstack@n-api.service[105397]: INFO nova.api.openstack.requestlog [None req-5a54dae4-37f6-4254-b7a4-fe754a3fb77c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Oct 04 03:27:42.559784 dv-cinder-849143-9-smb devstack@n-api.service[105397]: [pid: 105397|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Oct 4 03:27:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:27:42.758738 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG nova.api.openstack.wsgi [None req-491e9b64-0654-4149-a95d-1d9afb369876 admin admin] Calling method '>' {{(pid=105396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:27:42.762057 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-491e9b64-0654-4149-a95d-1d9afb369876 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:27:42.762531 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-491e9b64-0654-4149-a95d-1d9afb369876 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:27:42.762949 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-491e9b64-0654-4149-a95d-1d9afb369876 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:27:42.763679 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-491e9b64-0654-4149-a95d-1d9afb369876 admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:27:42.764117 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-491e9b64-0654-4149-a95d-1d9afb369876 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:27:42.764526 dv-cinder-849143-9-smb devstack@n-api.service[105396]: DEBUG oslo_concurrency.lockutils [None req-491e9b64-0654-4149-a95d-1d9afb369876 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:27:42.786235 dv-cinder-849143-9-smb devstack@n-api.service[105396]: INFO nova.api.openstack.requestlog [None req-491e9b64-0654-4149-a95d-1d9afb369876 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1029 microversion: 2.92 time: 0.084261 Oct 04 03:27:42.786750 dv-cinder-849143-9-smb devstack@n-api.service[105396]: [pid: 105396|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Oct 4 03:27:42 2022] GET /compute/v2.1/os-services => generated 1029 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:28:42.284797 dv-cinder-849143-9-smb systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 03:28:42.289524 dv-cinder-849143-9-smb devstack@n-api.service[105395]: Tue Oct 4 03:28:42 2022 - graceful shutdown triggered... Oct 04 03:28:42.290140 dv-cinder-849143-9-smb devstack@n-api.service[105397]: Gracefully killing worker 2 (pid: 105397)... Oct 04 03:28:42.290536 dv-cinder-849143-9-smb devstack@n-api.service[105396]: Gracefully killing worker 1 (pid: 105396)... Oct 04 03:28:42.411505 dv-cinder-849143-9-smb devstack@n-api.service[105397]: DEBUG dbcounter [-] [105397] Writing DB stats nova_api:SELECT=4 {{(pid=105397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:28:43.286235 dv-cinder-849143-9-smb devstack@n-api.service[105395]: worker 1 buried after 1 seconds Oct 04 03:28:43.286235 dv-cinder-849143-9-smb devstack@n-api.service[105395]: worker 2 buried after 1 seconds Oct 04 03:28:43.286235 dv-cinder-849143-9-smb devstack@n-api.service[105395]: goodbye to uWSGI. Oct 04 03:28:43.287858 dv-cinder-849143-9-smb systemd[1]: devstack@n-api.service: Succeeded. Oct 04 03:28:43.288982 dv-cinder-849143-9-smb systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 03:28:43.291686 dv-cinder-849143-9-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 03:28:43.313188 dv-cinder-849143-9-smb devstack@n-api.service[120581]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 03:28:43.315393 dv-cinder-849143-9-smb devstack@n-api.service[120581]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 03:28:43 2022] *** Oct 04 03:28:43.315393 dv-cinder-849143-9-smb devstack@n-api.service[120581]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 03:28:43.315393 dv-cinder-849143-9-smb devstack@n-api.service[120581]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 03:28:43.315393 dv-cinder-849143-9-smb devstack@n-api.service[120581]: nodename: dv-cinder-849143-9-smb Oct 04 03:28:43.315393 dv-cinder-849143-9-smb devstack@n-api.service[120581]: machine: x86_64 Oct 04 03:28:43.315393 dv-cinder-849143-9-smb devstack@n-api.service[120581]: clock source: unix Oct 04 03:28:43.315393 dv-cinder-849143-9-smb devstack@n-api.service[120581]: pcre jit disabled Oct 04 03:28:43.315393 dv-cinder-849143-9-smb devstack@n-api.service[120581]: detected number of CPU cores: 4 Oct 04 03:28:43.315393 dv-cinder-849143-9-smb devstack@n-api.service[120581]: current working directory: / Oct 04 03:28:43.315393 dv-cinder-849143-9-smb devstack@n-api.service[120581]: detected binary path: /usr/bin/uwsgi-core Oct 04 03:28:43.316156 dv-cinder-849143-9-smb devstack@n-api.service[120581]: your processes number limit is 47680 Oct 04 03:28:43.316156 dv-cinder-849143-9-smb devstack@n-api.service[120581]: your memory page size is 4096 bytes Oct 04 03:28:43.316156 dv-cinder-849143-9-smb devstack@n-api.service[120581]: detected max file descriptor number: 2048 Oct 04 03:28:43.316156 dv-cinder-849143-9-smb devstack@n-api.service[120581]: lock engine: pthread robust mutexes Oct 04 03:28:43.316156 dv-cinder-849143-9-smb devstack@n-api.service[120581]: thunder lock: enabled Oct 04 03:28:43.316156 dv-cinder-849143-9-smb devstack@n-api.service[120581]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 03:28:43.316156 dv-cinder-849143-9-smb devstack@n-api.service[120581]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 03:28:43.358892 dv-cinder-849143-9-smb devstack@n-api.service[120581]: Python main interpreter initialized at 0x56418dc4e9c0 Oct 04 03:28:43.358892 dv-cinder-849143-9-smb devstack@n-api.service[120581]: python threads support enabled Oct 04 03:28:43.358892 dv-cinder-849143-9-smb devstack@n-api.service[120581]: your server socket listen backlog is limited to 100 connections Oct 04 03:28:43.358892 dv-cinder-849143-9-smb devstack@n-api.service[120581]: your mercy for graceful operations on workers is 90 seconds Oct 04 03:28:43.359358 dv-cinder-849143-9-smb devstack@n-api.service[120581]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 03:28:43.359358 dv-cinder-849143-9-smb devstack@n-api.service[120581]: *** Operational MODE: preforking *** Oct 04 03:28:43.359555 dv-cinder-849143-9-smb devstack@n-api.service[120581]: *** uWSGI is running in multiple interpreter mode *** Oct 04 03:28:43.359555 dv-cinder-849143-9-smb devstack@n-api.service[120581]: spawned uWSGI master process (pid: 120581) Oct 04 03:28:43.359755 dv-cinder-849143-9-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 04 03:28:43.360672 dv-cinder-849143-9-smb devstack@n-api.service[120581]: spawned uWSGI worker 1 (pid: 120594, cores: 1) Oct 04 03:28:43.360672 dv-cinder-849143-9-smb devstack@n-api.service[120581]: spawned uWSGI worker 2 (pid: 120595, cores: 1) Oct 04 03:28:43.360850 dv-cinder-849143-9-smb devstack@n-api.service[120581]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 03:28:44.026805 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 03:28:44.049799 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 03:28:45.198819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 03:28:45.198819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: from cryptography.utils import int_from_bytes Oct 04 03:28:45.199434 dv-cinder-849143-9-smb devstack@n-api.service[120594]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 03:28:45.199434 dv-cinder-849143-9-smb devstack@n-api.service[120594]: from cryptography.utils import int_from_bytes Oct 04 03:28:45.231635 dv-cinder-849143-9-smb devstack@n-api.service[120595]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 03:28:45.231635 dv-cinder-849143-9-smb devstack@n-api.service[120595]: from cryptography.utils import int_from_bytes Oct 04 03:28:45.232236 dv-cinder-849143-9-smb devstack@n-api.service[120595]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 03:28:45.232236 dv-cinder-849143-9-smb devstack@n-api.service[120595]: from cryptography.utils import int_from_bytes Oct 04 03:28:47.684375 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 03:28:47.684983 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 03:28:47.685186 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 03:28:47.685553 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 03:28:47.685807 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 03:28:47.686200 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.686525 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.686846 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.687167 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.687617 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.687830 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.688153 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.688472 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.688801 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.689058 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.689371 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.689869 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-9-smb {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.690196 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.690509 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.690821 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.691142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.691448 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.691800 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.692120 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.692623 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.693347 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.693655 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.693965 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.694303 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.695146 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.695473 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.695804 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.696112 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.696442 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.696763 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.697163 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-9-smb {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.697490 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.697801 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.698114 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.698539 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.698866 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.699171 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.699480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.699899 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.700215 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.700545 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.700867 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.701186 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.701506 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.701809 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.702120 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.702431 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.702750 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.703055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.703358 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.703635 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.703942 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.704267 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.704586 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.704908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.705159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.705407 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.705740 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.706044 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.706353 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.706657 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.706964 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.707265 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.707592 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.707901 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.708203 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.708507 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.708824 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.709130 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.709456 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.709758 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.710693 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.711111 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.711367 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.711754 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.712105 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.712428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.712740 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.713060 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.713383 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.713692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.714003 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.714306 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.714625 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.714962 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.715266 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.715537 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.715847 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.716151 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.716470 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.716774 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.717079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.717382 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.717682 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.717992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.718296 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.718598 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.718903 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.719211 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.719531 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.719841 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.720153 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.720457 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.720760 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.721078 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.721398 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.721700 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.722002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.722305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.722609 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.722928 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.723231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.723556 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.723877 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.724180 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.724482 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.724798 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.725102 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.725405 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.725753 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.726053 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.726356 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.726675 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.726977 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.727283 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.727606 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.727925 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.728213 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.728515 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.728818 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.729118 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.729416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.729733 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.730016 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 03:28:47.730452 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.730556 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 03:28:47.730643 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.730643 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.730824 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 03:28:47.730925 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.731150 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 03:28:47.731244 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.731410 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 03:28:47.731603 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.731822 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.731929 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.732151 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.732251 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.732474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.732572 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.732793 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.732888 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.733124 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.733225 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.733436 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.733541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.733756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.733856 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.734070 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.734178 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.734402 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.734515 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.734664 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.734758 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.734981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.735093 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.735433 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.735841 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-9-smb {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.735941 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.736130 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.736268 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.736350 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.736457 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.736555 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.736659 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.736732 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.736875 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.737053 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.737186 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.737289 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.737486 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.737624 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.737808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.738093 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.738386 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.738527 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.738666 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.738872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.739069 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.739180 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.739275 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.739402 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.739532 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.739624 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.739775 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.739940 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.740042 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.740260 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.740361 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.740570 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.740682 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.740892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.740986 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.741292 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.741399 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.741788 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.741981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-9-smb {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.742112 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.742374 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.742475 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.742699 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.742805 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.743020 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.743115 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.743349 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.743450 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.743693 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.743803 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.744008 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.744110 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.744323 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.744424 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.744635 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.744739 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.744948 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.745054 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.745285 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.745386 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.745602 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.745705 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.745925 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.746020 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.746245 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.746345 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.746553 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.746700 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.746869 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.746977 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.747180 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.747295 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.747507 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.747660 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.747818 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.747923 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.748121 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.748224 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.748374 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.748513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.748682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.748777 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.749005 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.749118 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.749307 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.749411 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.749627 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.749722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.749867 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.749970 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.750116 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.750255 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.750435 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.750591 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.750756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.750900 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.751067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.751212 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.751376 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.751543 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.751709 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.751855 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.752016 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.752162 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.752324 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.752475 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.752631 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.752787 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.752935 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.753094 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.753231 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.753417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.753550 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.753729 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.753866 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.754033 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.754188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.754355 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.754497 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.754659 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.754816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.754968 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.755213 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.755320 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.755467 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.755621 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.755798 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.755902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.756141 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.756250 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.756463 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.756608 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.756781 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.757484 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.757741 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.757845 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.758059 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.758268 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.758400 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.758590 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.758733 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.758907 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.759043 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.759224 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.759369 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.759580 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.759724 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.759922 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.760047 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.760235 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.760337 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.760491 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.760650 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.760799 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.760956 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.761093 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.761262 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.761417 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.761568 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.761726 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.761878 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.762038 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.762181 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.762348 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.762484 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.762653 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.762788 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.762964 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.763090 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.763274 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.763396 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.763605 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.763747 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.763917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.764057 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.764225 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.764362 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.764533 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.764666 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.764840 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.764970 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.765150 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.765312 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.765456 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.765618 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.765762 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.765961 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.766081 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.766299 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.766401 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.766620 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.766722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.766944 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.767038 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.767257 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.767352 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.767598 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.767717 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.767909 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.768013 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.768221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.768316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.768527 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.768631 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.768835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.768938 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.769144 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.769279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.769453 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.769548 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.769773 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.769875 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.770080 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.770180 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.770386 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.770479 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.770698 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.770792 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.770999 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.771092 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.771307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.771409 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.771654 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.771783 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.771960 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.772080 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.772265 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.772379 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.773193 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.773314 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.773579 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.773769 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.773955 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.774096 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.774275 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.774377 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.774580 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.774685 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.774889 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.775018 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.775192 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.775291 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.775522 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.775637 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.775843 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.775938 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.776152 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.776250 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.776463 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.776572 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.776769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.776864 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.777087 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:28:47.777188 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.777394 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.777489 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.777716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.777817 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.778123 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.778334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.778436 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.778661 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.778755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.778997 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.779092 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.779308 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.779404 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.779642 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.779875 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.779966 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.780066 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.780271 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.780373 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.780579 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.780672 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.780889 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.780998 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.781192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.781294 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.781498 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.781594 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.781807 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.781911 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.782123 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.782218 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.782433 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.782526 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.782743 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.782846 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.783050 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.783152 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.783359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.783451 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.783693 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.783789 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.783998 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.784101 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.784302 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.784395 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.784612 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.784707 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.784934 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.785027 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.785246 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.785352 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.785569 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.785663 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.785893 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.785994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.786198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.786298 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.786503 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.786596 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.786825 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.786918 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.787133 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.787224 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.787440 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.787566 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.787773 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.787913 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.788113 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.788234 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.788521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.788692 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.788838 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.789148 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.789250 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.789468 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.789796 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.789898 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.790108 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.790398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.790500 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.790720 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.790976 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.791079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.791343 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.791594 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.791692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.791986 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.792198 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.792293 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.792593 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.792806 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.792909 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.793203 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.793402 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.793527 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.793837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.793930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.794149 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.794460 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.794552 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.794765 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.794885 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.795074 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.795224 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.795392 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.795603 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.795945 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.796070 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.796274 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.796397 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.796604 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.796709 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.796918 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.797029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.797233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.797337 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.797551 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.797670 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.797872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.797986 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.798186 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.798289 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.798496 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.798599 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.798801 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.798896 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.799111 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.799206 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.799415 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.799619 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.799754 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.799849 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.800066 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.800168 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.800370 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.800479 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.800676 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.800778 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.800982 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.801084 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.801293 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.801401 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.801597 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.801699 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.801901 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.801996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.802204 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.802308 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.802510 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.802612 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.802822 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.802924 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.803127 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.803231 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.803437 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.803551 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.803849 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.803947 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.804199 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.804471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.804564 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.804801 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.804904 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.805106 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.805210 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.805411 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.805505 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.805757 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.805859 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.806062 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.806164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.806390 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.806483 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.806716 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.806810 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.807057 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.807152 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.807363 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.807477 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.807692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.807790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.808017 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.808113 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.808319 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.808421 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.808623 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.808724 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.808926 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.809021 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.809235 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.809329 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.809541 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.809680 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.809848 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.809952 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.810152 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.810247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.810457 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.810562 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.810761 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.810854 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.811065 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.811165 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.811366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.811469 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.811708 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.811804 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.812017 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.812144 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.812329 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.812455 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.812638 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.812750 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.812943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.813056 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.813245 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.813358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.813548 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.813651 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.813851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.813962 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.814152 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.814258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.814460 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.814573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.814763 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.814867 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.815078 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.815198 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.815382 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.815507 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.815711 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.815833 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.816011 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.816114 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.816320 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.816422 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.816627 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.816735 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.816927 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.817049 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.817254 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.817366 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.817564 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.817682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.817868 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.818229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.818429 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.818601 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.818750 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.818912 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.819056 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.819214 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.820104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.820206 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.820302 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.820475 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.820570 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.820793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.820897 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.821097 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.821208 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.821461 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.821570 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.821727 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.821841 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.821999 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.822127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.822303 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.822455 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.822611 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.822773 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.822934 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.823133 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.823282 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.823427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.823604 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.823702 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.823820 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.824019 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.824123 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.824333 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.824427 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.824654 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.824748 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.824970 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.825074 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.825291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.825386 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.825592 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.825697 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.825918 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.826033 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.826229 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.826332 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.826546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.826648 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.826853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.826947 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.827180 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.827293 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.827513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.827630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.827830 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.827947 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.828145 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.828250 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.828540 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.828696 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.828788 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.828871 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.829066 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.829160 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.829384 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.829543 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.829700 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.829852 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.830002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.830192 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.830353 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.830499 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.830646 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.830786 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.830930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.831071 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.831221 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.831363 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.831546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.831651 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.831814 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.831911 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.832131 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.832227 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.832442 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.832543 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.832749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.832851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.833056 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.833159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.833363 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.833466 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.833679 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.833784 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.833989 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.834163 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.834299 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.834400 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.834615 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.834719 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.834935 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.835574 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.835876 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.836034 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.836191 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.836485 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.836591 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.836802 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.836905 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.837115 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.837220 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.837425 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.837536 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.837736 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.837833 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.838059 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.838175 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.838366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.838462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.838681 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.838797 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.838988 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.839093 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.839300 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.839405 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.839635 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.839742 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.839952 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.840192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.840290 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.840366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.840572 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.840683 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.840900 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.840996 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.841218 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.841312 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.841531 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.841640 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.841851 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.841967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.842164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.842266 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.842469 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.842561 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.842781 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.842874 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.843108 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.843203 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.843421 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.843550 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.843762 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.843859 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.844078 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.844172 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.844386 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.844488 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.844696 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.844798 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.845016 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.845109 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.845319 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.845589 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.845693 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.845915 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.846014 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.846230 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.846394 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.846548 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.846651 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.846855 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.846958 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.847205 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.847311 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.847573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.847673 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.847890 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.847999 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.848210 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.848311 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.848523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.848719 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.848951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.849109 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.849266 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.849429 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.849574 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.849726 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.849867 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.850025 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.850166 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.850327 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.850483 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.851138 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.851291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.851444 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.851615 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.851768 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.852019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.852160 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.852326 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.852480 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.852626 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.852769 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.852919 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.853078 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.853235 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.853386 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.853553 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.853699 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.853870 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.854021 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.854176 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.854317 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.854490 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.854633 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.854804 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.854958 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.855111 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.855251 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.855407 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.855537 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.855746 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.855880 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.856096 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.856227 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.856447 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.856569 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.856735 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.856848 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.857045 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.857148 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.857356 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.857459 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.857686 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.857803 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.857995 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.858172 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.858325 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.858481 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.858646 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.858818 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.858961 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.859095 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.859194 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.859282 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.859481 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.859645 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.859822 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.859990 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.860147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.860319 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.860474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.860623 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.860774 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.860918 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.861060 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.861201 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.861353 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.861494 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.861637 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.861780 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.861939 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.862124 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.862274 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.862451 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.862600 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.862759 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.862907 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.863052 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.863196 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.863338 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.863496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.863605 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.863723 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.863828 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.864035 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.864130 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.864344 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.864438 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.864658 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.864768 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.864965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.865067 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.865284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.865386 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.865592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.865687 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.865899 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.865992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.866284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.866925 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.867155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.867250 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.867597 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.867722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.867812 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.867938 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.868122 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.868281 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.868441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.868594 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.868737 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.868880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.869037 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.869180 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.869271 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.869474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.869578 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.869784 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.869907 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.870094 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.870199 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.870458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.870561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.870742 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.870905 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.871044 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.871147 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.871355 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.871448 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.871696 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.871801 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.872001 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.872095 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.872305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.872407 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.872626 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.872727 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.872907 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.873001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.873213 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.873322 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.873521 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.873624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.873829 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.873925 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.874135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.874254 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.874440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.874544 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.874751 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.874852 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.875061 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.875162 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.875367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.875470 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.875700 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.875810 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.876007 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.876102 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.876317 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.876419 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.876624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.876732 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.876937 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.877078 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.877251 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.877345 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.877565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.877673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.877917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.878092 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.878239 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.878448 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.878593 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.878772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.878912 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.879054 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.879239 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.879378 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.879558 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.879660 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.879773 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.879940 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.880090 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.880255 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.880410 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.880567 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.880691 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.880879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.881032 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.881186 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.881316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.881515 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.881610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.881868 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.882011 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.882198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.882537 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.882631 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.882853 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.882963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.883167 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.883276 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.883480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.883607 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.883818 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.883914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.884134 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.884241 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.884453 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.884555 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.884768 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.884862 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.885082 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.885177 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.885394 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.885496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.885706 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.885800 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.886016 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.886111 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.886324 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.886428 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.886632 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.886738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.886939 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.887034 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.887248 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.887351 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.887573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.887672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.887887 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.887982 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.888199 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.888301 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.888503 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.888610 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.888818 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.888914 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.889128 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.889294 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.889449 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.889630 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.889783 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.889927 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.890070 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.890221 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.890477 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.890662 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.890803 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.890952 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.891138 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.891281 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.891435 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.891600 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.891747 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.891900 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.892041 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.892183 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.892362 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.892500 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.892662 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.892799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.893023 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.893176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.893326 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.893481 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.893630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.893778 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.893921 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.894061 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.894300 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.894459 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.894609 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.894750 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.894898 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.895052 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.895202 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.895349 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.895517 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.895666 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.895808 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.895961 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.896102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.896254 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.896404 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.896597 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.896750 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.896905 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.897047 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.897214 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.897373 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.897658 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.897798 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.898066 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.898318 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.898482 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.898757 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.898852 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.899075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.899173 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.899393 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.899530 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.899737 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.899853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.900050 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.900147 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.900365 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.900481 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.900668 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.900806 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.900980 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.901084 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.901289 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.901393 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.901591 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.901685 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.901900 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.902003 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.902205 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.902308 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.902529 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.902639 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.902838 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.902945 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.903141 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.903237 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.903447 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.903593 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.903784 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.903888 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.904090 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.904199 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.904393 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.904497 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.904697 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.904824 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.905001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.905138 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.905313 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.905464 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.905617 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.905792 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.906008 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.906109 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.906315 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.906411 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.906626 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.906721 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.906976 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.907070 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.907283 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.907393 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.907614 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.907782 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.907930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.908073 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.908235 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.908398 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.908567 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.908713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.908812 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.908899 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.909113 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.909209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.909422 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.909580 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.909729 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.909914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.910058 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.910203 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.910373 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.910547 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.910685 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.910874 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.911022 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.911173 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.911322 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.911522 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.911669 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.911849 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.911995 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.912185 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.912336 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.912478 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.912636 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.912814 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.912991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.913673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.913826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.913967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.914183 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.914325 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.914514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.914659 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.914829 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.914972 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.915123 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.915279 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.915444 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.915558 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.915776 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.915883 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.916085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.916181 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.916393 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.916488 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.916701 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.916805 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.917009 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.917104 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.917316 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.917418 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.917623 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.917742 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.917934 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.918052 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.918238 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.918341 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.918546 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.918686 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.918835 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.918934 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.919143 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.919239 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.919450 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.919584 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.919786 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.919881 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.920095 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.920199 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.920404 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.920499 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.920712 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.920815 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.921024 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.921126 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.921330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.921423 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.921637 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.921732 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.921953 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.922049 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.922261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.922366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.922571 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.922702 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.922873 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.922975 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.923216 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.923324 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.923546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.923673 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.923881 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.924073 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.924175 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.924271 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.924505 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.924654 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.924821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.924975 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.925138 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.925295 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.925438 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.925586 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.925735 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.925890 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.926031 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.926173 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.926356 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.926496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.926672 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.926815 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.926984 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.927139 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.927302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.927446 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.927629 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.927724 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.927934 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.928027 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.928252 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.928466 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.928575 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.929337 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.929515 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.929829 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.929944 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.930315 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.930432 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.930626 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.930790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.930943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.931039 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.931249 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.931353 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.931583 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.931740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.931892 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.931995 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.932197 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.932301 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.932505 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.932602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.932806 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.932908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.933107 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.933211 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.933409 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.933504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.933711 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.933816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.934009 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.934125 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.934313 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.934413 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.934619 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.934728 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.934922 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.935016 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.935225 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.935330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.935545 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.935655 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.935849 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.935959 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.936150 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.936270 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.936479 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.936574 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.936813 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.936908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.937128 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.937230 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.937452 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.937554 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.937763 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.937858 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.938085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.938178 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.938395 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.938503 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.938700 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.938850 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.939016 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.939122 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.939328 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.939508 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.939663 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.939784 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.939998 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.940120 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.940311 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.940444 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.940621 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.940747 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.940921 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.941029 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.941234 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.941329 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.941546 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.941756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.941926 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.942083 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.942227 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.942397 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.942551 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.942728 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.942883 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.943325 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.943446 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.943669 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.943765 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.943988 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.944095 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.944327 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.944429 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.944645 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.944869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.945017 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.945224 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.945321 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.945543 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.945638 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.945860 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.945969 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.946166 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.946260 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.946474 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.946569 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.946786 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.946893 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.947092 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.947185 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.947400 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.947525 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.947739 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.947848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.948052 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.948274 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.948369 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.948627 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.948731 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.948950 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.949048 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.949266 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.949360 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.949597 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.949774 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.949928 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.950164 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.950313 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.950475 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.950621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.950773 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.951008 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.951151 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.951301 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.951453 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.951588 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.951689 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.951784 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.951871 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.952016 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 03:28:47.952111 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.952347 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.952662 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.952976 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.953286 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.953602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.953911 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.954239 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.954548 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.954857 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.955164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.955478 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.955808 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.956116 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.956424 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.956732 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.957048 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.957354 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.957750 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.958060 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.958375 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.958741 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.959052 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.959359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.959711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.960056 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.960605 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.961042 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.961363 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.961695 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.962021 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.962336 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.962691 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.963015 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.963580 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.963923 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.964250 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.964589 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.964926 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.965237 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.965549 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.965859 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.966184 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.966497 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.966812 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.967126 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.967437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.967777 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.968090 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.968403 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.968732 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.969026 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.969338 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.969650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.969963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.970274 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.970586 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.970903 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.971247 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.971591 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.971915 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.972235 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.972557 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.972874 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.973187 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.973500 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.973814 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.974135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.974467 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.974783 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.975091 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.975526 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.976500 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.977017 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.977352 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.977671 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.978005 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.978333 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.978651 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.978976 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.979290 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.979646 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.979990 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.980321 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.980650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.980959 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.981270 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.981577 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.981890 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.982227 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.982526 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.982830 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.983137 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.983449 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.983778 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.984085 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.984392 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.984696 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.985006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.985310 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.985616 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.985921 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.986225 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.986529 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.986832 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.987141 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.987445 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.987981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.988157 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.988500 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.988762 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.989097 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.989430 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.989746 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.990073 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.990387 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.990716 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.991025 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.992187 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.992636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.992969 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.993287 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.993631 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.993949 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.994263 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.994581 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.994899 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.995214 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.995551 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.995883 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.996212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.996524 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.996855 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.997177 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.997501 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.997820 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.998139 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.998471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.998784 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.999099 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.999413 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:47.999751 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.000068 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.000387 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.000701 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.001014 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.001331 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.001651 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.001981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.002309 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.002623 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.002953 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.003278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.003663 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.003985 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.004332 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.004662 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.004981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.005296 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.005604 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:28:48.005848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 03:28:48.012390 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO dbcounter [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] Registered counter for database nova_api Oct 04 03:28:48.032807 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_db.sqlalchemy.engines [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:28:48.040049 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writer thread running {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:28:48.068687 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO dbcounter [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] Registered counter for database nova_api Oct 04 03:28:48.089837 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_db.sqlalchemy.engines [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:28:48.096857 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writer thread running {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:28:48.101627 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.context [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c793cbfa-d3d2-4516-ac60-2697c5f19478(cell1) {{(pid=120594) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 03:28:48.106439 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:28:48.106919 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:28:48.108562 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:28:48.109311 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:28:48.109754 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:28:48.111836 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:28:48.113829 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO dbcounter [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] Registered counter for database nova_cell0 Oct 04 03:28:48.118358 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO dbcounter [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] Registered counter for database nova_cell1 Oct 04 03:28:48.127763 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_db.sqlalchemy.engines [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:28:48.128600 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_db.sqlalchemy.engines [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:28:48.136324 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writer thread running {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:28:48.137605 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writer thread running {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:28:48.157204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.context [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c793cbfa-d3d2-4516-ac60-2697c5f19478(cell1) {{(pid=120595) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 03:28:48.165029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:28:48.165029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:28:48.165029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:28:48.165029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:28:48.165530 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:28:48.167480 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:28:48.169502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO dbcounter [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] Registered counter for database nova_cell0 Oct 04 03:28:48.173705 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO dbcounter [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] Registered counter for database nova_cell1 Oct 04 03:28:48.184146 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_db.sqlalchemy.engines [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:28:48.184974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_db.sqlalchemy.engines [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:28:48.192095 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writer thread running {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:28:48.193659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writer thread running {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:28:48.303085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO dbcounter [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] Registered counter for database nova_cell0 Oct 04 03:28:48.310940 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_db.sqlalchemy.engines [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:28:48.315468 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writer thread running {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:28:48.346727 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO dbcounter [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] Registered counter for database nova_cell0 Oct 04 03:28:48.354321 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_db.sqlalchemy.engines [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:28:48.359600 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writer thread running {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:28:48.643715 dv-cinder-849143-9-smb devstack@n-api.service[120594]: WARNING keystonemiddleware.auth_token [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 03:28:48.651914 dv-cinder-849143-9-smb devstack@n-api.service[120594]: WARNING keystonemiddleware.auth_token [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 03:28:48.683232 dv-cinder-849143-9-smb devstack@n-api.service[120595]: WARNING keystonemiddleware.auth_token [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 03:28:48.690641 dv-cinder-849143-9-smb devstack@n-api.service[120595]: WARNING keystonemiddleware.auth_token [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 03:28:49.004730 dv-cinder-849143-9-smb devstack@n-api.service[120594]: WARNING keystonemiddleware.auth_token [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 03:28:49.011040 dv-cinder-849143-9-smb devstack@n-api.service[120594]: WARNING keystonemiddleware.auth_token [None req-341fe061-6d3d-4076-9a39-931e24c0dfbb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 03:28:49.016429 dv-cinder-849143-9-smb devstack@n-api.service[120594]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56418dc4e9c0 pid: 120594 (default app) Oct 04 03:28:49.041147 dv-cinder-849143-9-smb devstack@n-api.service[120595]: WARNING keystonemiddleware.auth_token [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 03:28:49.047241 dv-cinder-849143-9-smb devstack@n-api.service[120595]: WARNING keystonemiddleware.auth_token [None req-4651572f-0659-4dbc-bf39-e4dc9a80b661 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 03:28:49.052557 dv-cinder-849143-9-smb devstack@n-api.service[120595]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56418dc4e9c0 pid: 120595 (default app) Oct 04 03:29:24.979587 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:24.980930 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:24.982516 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:24.983378 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:25.761696 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=3 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:25.763668 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=3 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:25.764951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=3 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:25.768358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=3 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:26.221547 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c87180e5-dc4d-4613-8e3b-667d0715919e tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Action: 'create', calling method: .version_select at 0x7f165c5234c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2146530867", "metadata": {"Type": "work"}}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c87180e5-dc4d-4613-8e3b-667d0715919e tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Request method failure captured: Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 122 Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6iVR9c5diko0bxwgosoUIBeeQ-DTpbrPWAfXZqDPSv9OFqT_8ESYkg12eoJ3AbflS5EAWb5jgQYCO_KnT4J85JEaEsuMZyjG4GwJKg08oVqQtPb2MYVm0lgptgHtbSKPElsc4U8eGB5EybnoJozWxZLKJoY5OmIJDdDsdKiF6XY1mw Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 354343c5e5ea48148626b0ec9af93d56 Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:29:26.228302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:29:26.229914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/354343c5e5ea48148626b0ec9af93d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/354343c5e5ea48148626b0ec9af93d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_354343c5e5ea48148626b0ec9af93d56", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/354343c5e5ea48148626b0ec9af93d56"}]}] Oct 04 03:29:26.229914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.229914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 354343c5e5ea48148626b0ec9af93d56 Oct 04 03:29:26.229914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.229914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-VolumesNegativeTest-1319427571-project Oct 04 03:29:26.229914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:29:26.229914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:29:26.229914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 5e6b0c230f054f8f8cb7c9daa508316f Oct 04 03:29:26.229914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-VolumesNegativeTest-1319427571-project Oct 04 03:29:26.229914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Oct 04 03:29:26.229914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2146530867", "metadata": {"Type": "work"}}} Oct 04 03:29:26.229914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: Oct 04 03:29:26.229914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2146530867', 'metadata': {'Type': 'work'}}}} Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise error Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:29:26.230821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 03:29:26.232442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 03:29:26.233837 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 03:29:26.233837 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.234695 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c87180e5-dc4d-4613-8e3b-667d0715919e tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:29:26.235829 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c87180e5-dc4d-4613-8e3b-667d0715919e tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.479949 Oct 04 03:29:26.236833 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Oct 4 03:29:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 482 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 03:29:26.246994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9f179653-99f3-4ecb-aec5-6e1757020c74 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Action: 'create', calling method: .version_select at 0x7f165c523dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1162953476", "metadata": {"Type": "work"}}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9f179653-99f3-4ecb-aec5-6e1757020c74 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Request method failure captured: Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 120 Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6iVR9c5diko0bxwgosoUIBeeQ-DTpbrPWAfXZqDPSv9OFqT_8ESYkg12eoJ3AbflS5EAWb5jgQYCO_KnT4J85JEaEsuMZyjG4GwJKg08oVqQtPb2MYVm0lgptgHtbSKPElsc4U8eGB5EybnoJozWxZLKJoY5OmIJDdDsdKiF6XY1mw Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 354343c5e5ea48148626b0ec9af93d56 Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:29:26.251204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:29:26.254029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/354343c5e5ea48148626b0ec9af93d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/354343c5e5ea48148626b0ec9af93d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_354343c5e5ea48148626b0ec9af93d56", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/354343c5e5ea48148626b0ec9af93d56"}]}] Oct 04 03:29:26.254029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.254029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 354343c5e5ea48148626b0ec9af93d56 Oct 04 03:29:26.254029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.254029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-VolumesNegativeTest-1319427571-project Oct 04 03:29:26.254029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:29:26.254029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:29:26.254029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 5e6b0c230f054f8f8cb7c9daa508316f Oct 04 03:29:26.254029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-VolumesNegativeTest-1319427571-project Oct 04 03:29:26.254029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Oct 04 03:29:26.254029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1162953476", "metadata": {"Type": "work"}}} Oct 04 03:29:26.254029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: Oct 04 03:29:26.254029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1162953476', 'metadata': {'Type': 'work'}}}} Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise error Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi '0' Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:29:26.254878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 03:29:26.256253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 03:29:26.257325 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 03:29:26.257325 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.257325 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9f179653-99f3-4ecb-aec5-6e1757020c74 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:29:26.257325 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-9f179653-99f3-4ecb-aec5-6e1757020c74 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009397 Oct 04 03:29:26.257325 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 2/2] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Oct 4 03:29:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 03:29:26.257653 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-586ea482-f1f3-4a95-9db6-577ba89bab9b tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Action: 'create', calling method: .version_select at 0x7f165c5244c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1368962664"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:29:26.263867 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-494781de-1e80-4db1-858e-54d719067e41 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Action: 'create', calling method: .version_select at 0x7f165c3de1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1352764987", "metadata": {"Type": "work"}}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-494781de-1e80-4db1-858e-54d719067e41 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Request method failure captured: Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 119 Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6iVR9c5diko0bxwgosoUIBeeQ-DTpbrPWAfXZqDPSv9OFqT_8ESYkg12eoJ3AbflS5EAWb5jgQYCO_KnT4J85JEaEsuMZyjG4GwJKg08oVqQtPb2MYVm0lgptgHtbSKPElsc4U8eGB5EybnoJozWxZLKJoY5OmIJDdDsdKiF6XY1mw Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 354343c5e5ea48148626b0ec9af93d56 Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:29:26.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:29:26.268842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/354343c5e5ea48148626b0ec9af93d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/354343c5e5ea48148626b0ec9af93d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_354343c5e5ea48148626b0ec9af93d56", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/354343c5e5ea48148626b0ec9af93d56"}]}] Oct 04 03:29:26.268842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.268842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 354343c5e5ea48148626b0ec9af93d56 Oct 04 03:29:26.268842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.268842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-VolumesNegativeTest-1319427571-project Oct 04 03:29:26.268842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:29:26.268842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:29:26.268842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 5e6b0c230f054f8f8cb7c9daa508316f Oct 04 03:29:26.268842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-VolumesNegativeTest-1319427571-project Oct 04 03:29:26.268842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Oct 04 03:29:26.268842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1352764987", "metadata": {"Type": "work"}}} Oct 04 03:29:26.268842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: Oct 04 03:29:26.268842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1352764987', 'metadata': {'Type': 'work'}}}} Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise error Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi '' Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:29:26.269636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 03:29:26.270879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 03:29:26.272707 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 03:29:26.272707 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.272707 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-494781de-1e80-4db1-858e-54d719067e41 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:29:26.272707 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-494781de-1e80-4db1-858e-54d719067e41 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010658 Oct 04 03:29:26.274049 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 3/3] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Oct 4 03:29:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 03:29:26.288147 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-690a0b3a-5e5c-40fd-868d-529f8c95805a tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Calling method '.version_select at 0x7f165c3dec10>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:26.518168 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-690a0b3a-5e5c-40fd-868d-529f8c95805a tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] HTTP exception thrown: Volume tempest-invalid-1314625017 could not be found. Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-690a0b3a-5e5c-40fd-868d-529f8c95805a tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Request method failure captured: Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1314625017 HTTP/1.1 Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6iVR9c5diko0bxwgosoUIBeeQ-DTpbrPWAfXZqDPSv9OFqT_8ESYkg12eoJ3AbflS5EAWb5jgQYCO_KnT4J85JEaEsuMZyjG4GwJKg08oVqQtPb2MYVm0lgptgHtbSKPElsc4U8eGB5EybnoJozWxZLKJoY5OmIJDdDsdKiF6XY1mw Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 354343c5e5ea48148626b0ec9af93d56 Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:29:26.522223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:29:26.523592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/354343c5e5ea48148626b0ec9af93d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/354343c5e5ea48148626b0ec9af93d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_354343c5e5ea48148626b0ec9af93d56", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/354343c5e5ea48148626b0ec9af93d56"}]}] Oct 04 03:29:26.523592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.523592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 354343c5e5ea48148626b0ec9af93d56 Oct 04 03:29:26.523592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.523592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-VolumesNegativeTest-1319427571-project Oct 04 03:29:26.523592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:29:26.523592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:29:26.523592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 5e6b0c230f054f8f8cb7c9daa508316f Oct 04 03:29:26.523592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-VolumesNegativeTest-1319427571-project Oct 04 03:29:26.523592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: Oct 04 03:29:26.523592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Volume tempest-invalid-1314625017 could not be found. Oct 04 03:29:26.523592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': 'tempest-invalid-1314625017'} Oct 04 03:29:26.523592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1314625017 could not be found. (HTTP 404) (Request-ID: req-3f7e768d-ee54-46cd-a805-d73cdbbe2373) Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.524471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 03:29:26.525678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1314625017 could not be found. Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:29:26.526981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1314625017 could not be found. Oct 04 03:29:26.530154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.530154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.530154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.530154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.530154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:26.530154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:26.530154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:29:26.530154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:29:26.530154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1314625017 could not be found. Oct 04 03:29:26.530154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.530154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-690a0b3a-5e5c-40fd-868d-529f8c95805a tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Returning 404 to user: Volume tempest-invalid-1314625017 could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:29:26.530154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-690a0b3a-5e5c-40fd-868d-529f8c95805a tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1314625017" status: 404 len: 99 microversion: 2.1 time: 0.241489 Oct 04 03:29:26.530154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 4/4] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Oct 4 03:29:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1314625017 => generated 99 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 03:29:26.537605 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2cb59102-5394-4052-ab1e-10671bdf0540 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005027 Oct 04 03:29:26.538110 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 5/5] 10.222.0.25 () {58 vars in 1140 bytes} [Tue Oct 4 03:29:26 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 03:29:26.546567 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-07092abe-9298-4747-bdaa-a2847425fec8 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003588 Oct 04 03:29:26.547057 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 6/6] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Oct 4 03:29:26 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 03:29:26.557697 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-53f7f63b-f00a-413e-9c34-f30f725e7c37 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Calling method '.version_select at 0x7f165c363e50>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:26.595354 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-53f7f63b-f00a-413e-9c34-f30f725e7c37 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] HTTP exception thrown: Volume 4506e644-23c9-4266-bf30-fa7665323e51 could not be found. Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-53f7f63b-f00a-413e-9c34-f30f725e7c37 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Request method failure captured: Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: DELETE /compute/v2.1/os-volumes/4506e644-23c9-4266-bf30-fa7665323e51 HTTP/1.1 Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6iVR9c5diko0bxwgosoUIBeeQ-DTpbrPWAfXZqDPSv9OFqT_8ESYkg12eoJ3AbflS5EAWb5jgQYCO_KnT4J85JEaEsuMZyjG4GwJKg08oVqQtPb2MYVm0lgptgHtbSKPElsc4U8eGB5EybnoJozWxZLKJoY5OmIJDdDsdKiF6XY1mw Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 354343c5e5ea48148626b0ec9af93d56 Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:29:26.598673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:29:26.600673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/354343c5e5ea48148626b0ec9af93d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/354343c5e5ea48148626b0ec9af93d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_354343c5e5ea48148626b0ec9af93d56", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/354343c5e5ea48148626b0ec9af93d56"}]}] Oct 04 03:29:26.600673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.600673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 354343c5e5ea48148626b0ec9af93d56 Oct 04 03:29:26.600673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.600673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-VolumesNegativeTest-1319427571-project Oct 04 03:29:26.600673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:29:26.600673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:29:26.600673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 5e6b0c230f054f8f8cb7c9daa508316f Oct 04 03:29:26.600673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-VolumesNegativeTest-1319427571-project Oct 04 03:29:26.600673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: Oct 04 03:29:26.600673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Volume 4506e644-23c9-4266-bf30-fa7665323e51 could not be found. Oct 04 03:29:26.600673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '4506e644-23c9-4266-bf30-fa7665323e51'} Oct 04 03:29:26.600673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4506e644-23c9-4266-bf30-fa7665323e51 could not be found. (HTTP 404) (Request-ID: req-981370ac-7491-4fe5-9cb2-6dfa83843035) Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.601611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 03:29:26.602693 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4506e644-23c9-4266-bf30-fa7665323e51 could not be found. Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 03:29:26.603816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:29:26.606951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4506e644-23c9-4266-bf30-fa7665323e51 could not be found. Oct 04 03:29:26.606951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.606951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.606951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.606951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.606951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:26.606951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:26.606951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:29:26.606951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:29:26.606951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4506e644-23c9-4266-bf30-fa7665323e51 could not be found. Oct 04 03:29:26.606951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.606951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-53f7f63b-f00a-413e-9c34-f30f725e7c37 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Returning 404 to user: Volume 4506e644-23c9-4266-bf30-fa7665323e51 could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:29:26.606951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-53f7f63b-f00a-413e-9c34-f30f725e7c37 tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/4506e644-23c9-4266-bf30-fa7665323e51" status: 404 len: 109 microversion: 2.1 time: 0.048265 Oct 04 03:29:26.606951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 7/7] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Oct 4 03:29:26 2022] DELETE /compute/v2.1/os-volumes/4506e644-23c9-4266-bf30-fa7665323e51 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:29:26.613393 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-cdfabee3-a051-4cb0-98b0-67718fb0597f tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Calling method '.version_select at 0x7f165c3155e0>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:26.666010 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-cdfabee3-a051-4cb0-98b0-67718fb0597f tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] HTTP exception thrown: Volume 812b477c-10e5-4439-b179-9a89bccc9459 could not be found. Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-cdfabee3-a051-4cb0-98b0-67718fb0597f tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Request method failure captured: Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/os-volumes/812b477c-10e5-4439-b179-9a89bccc9459 HTTP/1.1 Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6iVR9c5diko0bxwgosoUIBeeQ-DTpbrPWAfXZqDPSv9OFqT_8ESYkg12eoJ3AbflS5EAWb5jgQYCO_KnT4J85JEaEsuMZyjG4GwJKg08oVqQtPb2MYVm0lgptgHtbSKPElsc4U8eGB5EybnoJozWxZLKJoY5OmIJDdDsdKiF6XY1mw Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 354343c5e5ea48148626b0ec9af93d56 Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:29:26.668994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:29:26.670427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/354343c5e5ea48148626b0ec9af93d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/354343c5e5ea48148626b0ec9af93d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_354343c5e5ea48148626b0ec9af93d56", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/354343c5e5ea48148626b0ec9af93d56"}]}] Oct 04 03:29:26.670427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.670427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 354343c5e5ea48148626b0ec9af93d56 Oct 04 03:29:26.670427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-VolumesNegativeTest-1319427571 Oct 04 03:29:26.670427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-VolumesNegativeTest-1319427571-project Oct 04 03:29:26.670427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:29:26.670427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:29:26.670427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 5e6b0c230f054f8f8cb7c9daa508316f Oct 04 03:29:26.670427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-VolumesNegativeTest-1319427571-project Oct 04 03:29:26.670427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: Oct 04 03:29:26.670427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Volume 812b477c-10e5-4439-b179-9a89bccc9459 could not be found. Oct 04 03:29:26.670427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '812b477c-10e5-4439-b179-9a89bccc9459'} Oct 04 03:29:26.670427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 812b477c-10e5-4439-b179-9a89bccc9459 could not be found. (HTTP 404) (Request-ID: req-a1eecfaf-d392-4a75-b089-6730292c7b71) Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.671330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 03:29:26.676438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 812b477c-10e5-4439-b179-9a89bccc9459 could not be found. Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 03:29:26.677573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:29:26.678711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 812b477c-10e5-4439-b179-9a89bccc9459 could not be found. Oct 04 03:29:26.678711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.678711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:26.678711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.678711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:26.678711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:26.678711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:26.678711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:29:26.678711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:29:26.678711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 812b477c-10e5-4439-b179-9a89bccc9459 could not be found. Oct 04 03:29:26.678711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:26.678711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-cdfabee3-a051-4cb0-98b0-67718fb0597f tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] Returning 404 to user: Volume 812b477c-10e5-4439-b179-9a89bccc9459 could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:29:26.678711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-cdfabee3-a051-4cb0-98b0-67718fb0597f tempest-VolumesNegativeTest-1319427571 tempest-VolumesNegativeTest-1319427571-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/812b477c-10e5-4439-b179-9a89bccc9459" status: 404 len: 109 microversion: 2.1 time: 0.061692 Oct 04 03:29:26.678711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 8/8] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Oct 4 03:29:26 2022] GET /compute/v2.1/os-volumes/812b477c-10e5-4439-b179-9a89bccc9459 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:29:26.832391 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-dff50bc1-a230-4c83-ab2a-66d344835838 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] Calling method '.version_select at 0x7f165c363d30>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:26.927165 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-dff50bc1-a230-4c83-ab2a-66d344835838 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/fdb2d8f3-aab4-4a83-9682-4d8685c34624" status: 200 len: 351 microversion: 2.1 time: 0.098416 Oct 04 03:29:26.929470 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 9/9] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Oct 4 03:29:26 2022] GET /compute/v2.1/os-volumes/fdb2d8f3-aab4-4a83-9682-4d8685c34624 => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:29:27.144935 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-586ea482-f1f3-4a95-9db6-577ba89bab9b tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.171437 Oct 04 03:29:27.145566 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 1/10] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Oct 4 03:29:24 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2174 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 03:29:27.161169 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-46982811-4ea1-4166-aa19-c1c790143aa5 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Calling method '.version_select at 0x7f165c3153a0>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:27.335983 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-46982811-4ea1-4166-aa19-c1c790143aa5 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c" status: 200 len: 345 microversion: 2.1 time: 0.178902 Oct 04 03:29:27.336566 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 10/11] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Oct 4 03:29:27 2022] GET /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c => generated 345 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:28.352624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-438a5bd3-2f74-40b2-9f85-73cb6bd0fe00 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Calling method '.version_select at 0x7f165c3f93a0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:28.463797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-438a5bd3-2f74-40b2-9f85-73cb6bd0fe00 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c" status: 200 len: 346 microversion: 2.1 time: 0.115428 Oct 04 03:29:28.473643 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 2/12] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Oct 4 03:29:28 2022] GET /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c => generated 346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:28.478383 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6d4f75d9-e74e-48d3-bbf9-223334587eef tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Action: 'create', calling method: .version_select at 0x7f165c3210d0>, body: {"snapshot": {"volume_id": "77f85157-47bd-4c94-a3bd-8bebbf68ca8c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1743311717"}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:29:28.858046 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e0cb7d2a-0a1b-4ddc-b326-6ac9690fec09 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] Calling method '.version_select at 0x7f165c3f9a60>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:29.020040 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e0cb7d2a-0a1b-4ddc-b326-6ac9690fec09 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/05dfde99-36e7-4096-aede-d692195ac9d2" status: 200 len: 351 microversion: 2.1 time: 0.167635 Oct 04 03:29:29.021299 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 3/13] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Oct 4 03:29:28 2022] GET /compute/v2.1/os-volumes/05dfde99-36e7-4096-aede-d692195ac9d2 => generated 351 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:29.095613 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6d4f75d9-e74e-48d3-bbf9-223334587eef tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.621083 Oct 04 03:29:29.098137 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 11/14] 10.222.0.25 () {60 vars in 1162 bytes} [Tue Oct 4 03:29:28 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:29:29.109309 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5f42b369-2cc9-4036-abb1-e37b5a6b8973 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Calling method '.version_select at 0x7f165c3901f0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:29.167575 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5f42b369-2cc9-4036-abb1-e37b5a6b8973 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9bd0c386-97c4-4e9d-a8fd-4505e15efe64" status: 200 len: 287 microversion: 2.1 time: 0.061979 Oct 04 03:29:29.168420 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 4/15] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Oct 4 03:29:29 2022] GET /compute/v2.1/os-snapshots/9bd0c386-97c4-4e9d-a8fd-4505e15efe64 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:29.183313 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-708594b6-7e8a-4d68-b91c-f03b53cb6d7c tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Calling method '.version_select at 0x7f165c315670>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:29.249639 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-708594b6-7e8a-4d68-b91c-f03b53cb6d7c tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.072319 Oct 04 03:29:29.250709 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 12/16] 10.222.0.25 () {58 vars in 1140 bytes} [Tue Oct 4 03:29:29 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:29.263822 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a7c00d5e-4556-44f3-996f-c07a0d672fcc tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Calling method '.version_select at 0x7f165c3f9ca0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:29.338528 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a7c00d5e-4556-44f3-996f-c07a0d672fcc tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9bd0c386-97c4-4e9d-a8fd-4505e15efe64" status: 200 len: 287 microversion: 2.1 time: 0.079201 Oct 04 03:29:29.342207 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 5/17] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Oct 4 03:29:29 2022] GET /compute/v2.1/os-snapshots/9bd0c386-97c4-4e9d-a8fd-4505e15efe64 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:30.358497 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-1399e45f-804f-40eb-a491-b6a41c500d5b tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Calling method '.version_select at 0x7f165c3203a0>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:30.550456 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-1399e45f-804f-40eb-a491-b6a41c500d5b tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9bd0c386-97c4-4e9d-a8fd-4505e15efe64" status: 200 len: 288 microversion: 2.1 time: 0.201374 Oct 04 03:29:30.551633 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 13/18] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Oct 4 03:29:30 2022] GET /compute/v2.1/os-snapshots/9bd0c386-97c4-4e9d-a8fd-4505e15efe64 => generated 288 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:30.569276 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-23517baf-e45e-492f-9b17-71f0697bb48d tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Calling method '.version_select at 0x7f165c3f95e0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:30.709971 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-23517baf-e45e-492f-9b17-71f0697bb48d tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/9bd0c386-97c4-4e9d-a8fd-4505e15efe64" status: 202 len: 0 microversion: 2.1 time: 0.144726 Oct 04 03:29:30.713989 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 6/19] 10.222.0.25 () {58 vars in 1254 bytes} [Tue Oct 4 03:29:30 2022] DELETE /compute/v2.1/os-snapshots/9bd0c386-97c4-4e9d-a8fd-4505e15efe64 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:29:30.719322 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-62761a35-7f68-40d9-91e1-e0434523f503 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Calling method '.version_select at 0x7f165c320af0>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:30.773262 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-62761a35-7f68-40d9-91e1-e0434523f503 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9bd0c386-97c4-4e9d-a8fd-4505e15efe64" status: 200 len: 287 microversion: 2.1 time: 0.057728 Oct 04 03:29:30.778496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 14/20] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Oct 4 03:29:30 2022] GET /compute/v2.1/os-snapshots/9bd0c386-97c4-4e9d-a8fd-4505e15efe64 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:31.110687 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e1839bd3-00b3-4bc5-ba67-1b82f92036af tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] Calling method '.version_select at 0x7f165c3903a0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:31.222085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e1839bd3-00b3-4bc5-ba67-1b82f92036af tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/addcce3e-f8ba-4cf3-925e-1267c81b4a90" status: 200 len: 351 microversion: 2.1 time: 0.115310 Oct 04 03:29:31.232043 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 7/21] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Oct 4 03:29:31 2022] GET /compute/v2.1/os-volumes/addcce3e-f8ba-4cf3-925e-1267c81b4a90 => generated 351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:31.245701 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-eac7483d-7eef-45aa-9662-4873931643d2 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] Calling method '.version_select at 0x7f165c363ca0>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:31.439441 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-eac7483d-7eef-45aa-9662-4873931643d2 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.199770 Oct 04 03:29:31.440801 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 15/22] 10.222.0.25 () {58 vars in 1134 bytes} [Tue Oct 4 03:29:31 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:29:31.463037 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-021c3317-c92e-4530-9fb3-ac22f5ff7eb8 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] Calling method '.version_select at 0x7f165c3f93a0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:31.674890 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-021c3317-c92e-4530-9fb3-ac22f5ff7eb8 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.218312 Oct 04 03:29:31.685700 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 8/23] 10.222.0.25 () {58 vars in 1149 bytes} [Tue Oct 4 03:29:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:31.692489 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-506f6f72-cd91-4d35-b683-37451c8a135d tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] Calling method '.version_select at 0x7f165c320040>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:31.786096 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-04afe1a4-e34d-4633-87ab-ffe404ac69d8 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Calling method '.version_select at 0x7f165c390550>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:31.825889 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-04afe1a4-e34d-4633-87ab-ffe404ac69d8 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] HTTP exception thrown: Snapshot 9bd0c386-97c4-4e9d-a8fd-4505e15efe64 could not be found. Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-04afe1a4-e34d-4633-87ab-ffe404ac69d8 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Request method failure captured: Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/os-snapshots/9bd0c386-97c4-4e9d-a8fd-4505e15efe64 HTTP/1.1 Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6iUAyr-UiKHtOq4zAa8RJVSEAqlOUmy48pCE7apSbMqyLEmgjnsrFxjJZkSWCdEd2tMm83YJ-51rK52SV6xMwdhc5TUx5AVfGFl10c9r7foovJChUr2-NQ70WiaRknPJycTeXw-Gfcy8785yQC0oZDUbRsbIdzHsmOVCTlo5JSDgpM Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: 18412a6002ce4900a089ca90f2e9f7b3 Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-78747751 Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:29:31.830221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:29:31.831480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18412a6002ce4900a089ca90f2e9f7b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18412a6002ce4900a089ca90f2e9f7b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18412a6002ce4900a089ca90f2e9f7b3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18412a6002ce4900a089ca90f2e9f7b3"}]}] Oct 04 03:29:31.831480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-VolumesSnapshotsTestJSON-78747751 Oct 04 03:29:31.831480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: 18412a6002ce4900a089ca90f2e9f7b3 Oct 04 03:29:31.831480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-78747751 Oct 04 03:29:31.831480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-VolumesSnapshotsTestJSON-78747751-project Oct 04 03:29:31.831480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:29:31.831480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:29:31.831480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: 0ce066d8dc8243bc9bb0b36250288677 Oct 04 03:29:31.831480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-VolumesSnapshotsTestJSON-78747751-project Oct 04 03:29:31.831480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: Oct 04 03:29:31.831480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Snapshot 9bd0c386-97c4-4e9d-a8fd-4505e15efe64 could not be found. Oct 04 03:29:31.831480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '9bd0c386-97c4-4e9d-a8fd-4505e15efe64'} Oct 04 03:29:31.831480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9bd0c386-97c4-4e9d-a8fd-4505e15efe64 could not be found. (HTTP 404) (Request-ID: req-3348c2e6-f315-4ec1-b624-7fc82d9c34e4) Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:29:31.832336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 03:29:31.833416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9bd0c386-97c4-4e9d-a8fd-4505e15efe64 could not be found. Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 03:29:31.834967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:29:31.836216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9bd0c386-97c4-4e9d-a8fd-4505e15efe64 could not be found. Oct 04 03:29:31.836216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:29:31.836216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:31.836216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:29:31.836216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:31.836216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:31.836216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:31.836216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:29:31.836216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:29:31.836216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9bd0c386-97c4-4e9d-a8fd-4505e15efe64 could not be found. Oct 04 03:29:31.836216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:29:31.838561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-04afe1a4-e34d-4633-87ab-ffe404ac69d8 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Returning 404 to user: Snapshot 9bd0c386-97c4-4e9d-a8fd-4505e15efe64 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:29:31.842950 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-04afe1a4-e34d-4633-87ab-ffe404ac69d8 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/9bd0c386-97c4-4e9d-a8fd-4505e15efe64" status: 404 len: 111 microversion: 2.1 time: 0.060556 Oct 04 03:29:31.847214 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 9/24] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Oct 4 03:29:31 2022] GET /compute/v2.1/os-snapshots/9bd0c386-97c4-4e9d-a8fd-4505e15efe64 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:29:31.857800 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-347986f1-58f8-4599-a1ee-d5d4a4e9b0ea tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Calling method '.version_select at 0x7f165c390c10>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:31.907938 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-506f6f72-cd91-4d35-b683-37451c8a135d tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.219033 Oct 04 03:29:31.908710 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 16/25] 10.222.0.25 () {58 vars in 1134 bytes} [Tue Oct 4 03:29:31 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:29:31.923717 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-eaccba3d-ca72-4608-a56a-21af417ed302 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] Calling method '.version_select at 0x7f165c32d4c0>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:32.034046 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-347986f1-58f8-4599-a1ee-d5d4a4e9b0ea tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c" status: 202 len: 0 microversion: 2.1 time: 0.185415 Oct 04 03:29:32.034873 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 10/26] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Oct 4 03:29:31 2022] DELETE /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:29:32.045142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-da548edb-a3f2-4e91-940e-65f9871357c4 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Calling method '.version_select at 0x7f165c3783a0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:32.143370 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-eaccba3d-ca72-4608-a56a-21af417ed302 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.223512 Oct 04 03:29:32.144121 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 17/27] 10.222.0.25 () {58 vars in 1167 bytes} [Tue Oct 4 03:29:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:32.160930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-680f092b-3ac3-4e2e-b5e7-18d9c63e4295 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] Calling method '.version_select at 0x7f165c3159d0>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:32.177704 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-da548edb-a3f2-4e91-940e-65f9871357c4 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c" status: 200 len: 345 microversion: 2.1 time: 0.137037 Oct 04 03:29:32.185993 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 11/28] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Oct 4 03:29:32 2022] GET /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c => generated 345 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:32.370011 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-680f092b-3ac3-4e2e-b5e7-18d9c63e4295 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.213558 Oct 04 03:29:32.370637 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 18/29] 10.222.0.25 () {58 vars in 1170 bytes} [Tue Oct 4 03:29:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:32.386107 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d25e6a05-7d8d-4c68-803f-ce8dd132f0c7 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] Calling method '.version_select at 0x7f165c390dc0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:32.484424 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d25e6a05-7d8d-4c68-803f-ce8dd132f0c7 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.103250 Oct 04 03:29:32.494053 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 12/30] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Oct 4 03:29:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:29:32.499767 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-28fcc7bd-46bb-460e-8e96-f6e94b774186 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] Calling method '.version_select at 0x7f165c321d30>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:32.701069 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-28fcc7bd-46bb-460e-8e96-f6e94b774186 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.205514 Oct 04 03:29:32.701709 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 19/31] 10.222.0.25 () {58 vars in 1188 bytes} [Tue Oct 4 03:29:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:32.716141 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-55f694fd-a3ec-4805-b16e-65e375b28ee2 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] Calling method '.version_select at 0x7f165c378f70>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:32.851106 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-55f694fd-a3ec-4805-b16e-65e375b28ee2 tempest-VolumesTestJSON-382572109 tempest-VolumesTestJSON-382572109-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.138873 Oct 04 03:29:32.852365 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 13/32] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Oct 4 03:29:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:29:33.197467 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-8e095c3f-6f10-444d-b00f-306b162448d8 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Calling method '.version_select at 0x7f165c32a550>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:33.258332 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-8e095c3f-6f10-444d-b00f-306b162448d8 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] HTTP exception thrown: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-8e095c3f-6f10-444d-b00f-306b162448d8 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Request method failure captured: Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c HTTP/1.1 Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6iUAyr-UiKHtOq4zAa8RJVSEAqlOUmy48pCE7apSbMqyLEmgjnsrFxjJZkSWCdEd2tMm83YJ-51rK52SV6xMwdhc5TUx5AVfGFl10c9r7foovJChUr2-NQ70WiaRknPJycTeXw-Gfcy8785yQC0oZDUbRsbIdzHsmOVCTlo5JSDgpM Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 18412a6002ce4900a089ca90f2e9f7b3 Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-78747751 Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:29:33.261212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:29:33.262440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18412a6002ce4900a089ca90f2e9f7b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18412a6002ce4900a089ca90f2e9f7b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18412a6002ce4900a089ca90f2e9f7b3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18412a6002ce4900a089ca90f2e9f7b3"}]}] Oct 04 03:29:33.262440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-VolumesSnapshotsTestJSON-78747751 Oct 04 03:29:33.262440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 18412a6002ce4900a089ca90f2e9f7b3 Oct 04 03:29:33.262440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-78747751 Oct 04 03:29:33.262440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-VolumesSnapshotsTestJSON-78747751-project Oct 04 03:29:33.262440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:29:33.262440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:29:33.262440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 0ce066d8dc8243bc9bb0b36250288677 Oct 04 03:29:33.262440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-VolumesSnapshotsTestJSON-78747751-project Oct 04 03:29:33.262440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: Oct 04 03:29:33.262440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.262440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '77f85157-47bd-4c94-a3bd-8bebbf68ca8c'} Oct 04 03:29:33.262440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. (HTTP 404) (Request-ID: req-43f89a94-1e5f-4be4-927e-88efc041fad7) Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:33.263043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 03:29:33.263961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 03:29:33.269359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:29:33.270496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.270496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.270496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:33.270496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.270496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:33.270496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:33.270496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:33.270496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:29:33.270496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:29:33.270496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.270496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.274066 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-8e095c3f-6f10-444d-b00f-306b162448d8 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Returning 404 to user: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:29:33.275024 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-8e095c3f-6f10-444d-b00f-306b162448d8 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c" status: 404 len: 109 microversion: 2.1 time: 0.085671 Oct 04 03:29:33.276446 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 20/33] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Oct 4 03:29:33 2022] GET /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:29:33.292873 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5de9fd47-0a38-4006-bbac-dbcfd682ef26 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Calling method '.version_select at 0x7f165c37d3a0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:33.329215 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-5de9fd47-0a38-4006-bbac-dbcfd682ef26 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] HTTP exception thrown: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5de9fd47-0a38-4006-bbac-dbcfd682ef26 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Request method failure captured: Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: DELETE /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c HTTP/1.1 Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6iUAyr-UiKHtOq4zAa8RJVSEAqlOUmy48pCE7apSbMqyLEmgjnsrFxjJZkSWCdEd2tMm83YJ-51rK52SV6xMwdhc5TUx5AVfGFl10c9r7foovJChUr2-NQ70WiaRknPJycTeXw-Gfcy8785yQC0oZDUbRsbIdzHsmOVCTlo5JSDgpM Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: 18412a6002ce4900a089ca90f2e9f7b3 Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-78747751 Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:29:33.331738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:29:33.332953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18412a6002ce4900a089ca90f2e9f7b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18412a6002ce4900a089ca90f2e9f7b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18412a6002ce4900a089ca90f2e9f7b3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18412a6002ce4900a089ca90f2e9f7b3"}]}] Oct 04 03:29:33.332953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-VolumesSnapshotsTestJSON-78747751 Oct 04 03:29:33.332953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: 18412a6002ce4900a089ca90f2e9f7b3 Oct 04 03:29:33.332953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-78747751 Oct 04 03:29:33.332953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-VolumesSnapshotsTestJSON-78747751-project Oct 04 03:29:33.332953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:29:33.332953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:29:33.332953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: 0ce066d8dc8243bc9bb0b36250288677 Oct 04 03:29:33.332953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-VolumesSnapshotsTestJSON-78747751-project Oct 04 03:29:33.332953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: Oct 04 03:29:33.332953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.332953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '77f85157-47bd-4c94-a3bd-8bebbf68ca8c'} Oct 04 03:29:33.332953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. (HTTP 404) (Request-ID: req-2025eca2-cbdc-4f9e-abda-4bb8647b99e7) Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:33.333647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 03:29:33.335068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 03:29:33.337023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:29:33.337904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.337904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.337904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:33.337904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.337904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:33.337904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:33.337904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:33.337904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:29:33.337904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:29:33.337904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.337904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.339923 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5de9fd47-0a38-4006-bbac-dbcfd682ef26 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Returning 404 to user: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:29:33.341107 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5de9fd47-0a38-4006-bbac-dbcfd682ef26 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c" status: 404 len: 109 microversion: 2.1 time: 0.051956 Oct 04 03:29:33.341786 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 14/34] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Oct 4 03:29:33 2022] DELETE /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 03:29:33.352569 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-466aee7c-ae5c-4d86-8fe1-b46971ed0644 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Calling method '.version_select at 0x7f165c32d040>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:33.405005 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-466aee7c-ae5c-4d86-8fe1-b46971ed0644 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] HTTP exception thrown: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-466aee7c-ae5c-4d86-8fe1-b46971ed0644 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Request method failure captured: Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c HTTP/1.1 Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6iUAyr-UiKHtOq4zAa8RJVSEAqlOUmy48pCE7apSbMqyLEmgjnsrFxjJZkSWCdEd2tMm83YJ-51rK52SV6xMwdhc5TUx5AVfGFl10c9r7foovJChUr2-NQ70WiaRknPJycTeXw-Gfcy8785yQC0oZDUbRsbIdzHsmOVCTlo5JSDgpM Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 18412a6002ce4900a089ca90f2e9f7b3 Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-78747751 Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:29:33.407585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:29:33.409135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18412a6002ce4900a089ca90f2e9f7b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/18412a6002ce4900a089ca90f2e9f7b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_18412a6002ce4900a089ca90f2e9f7b3", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/18412a6002ce4900a089ca90f2e9f7b3"}]}] Oct 04 03:29:33.409135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-VolumesSnapshotsTestJSON-78747751 Oct 04 03:29:33.409135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 18412a6002ce4900a089ca90f2e9f7b3 Oct 04 03:29:33.409135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-78747751 Oct 04 03:29:33.409135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-VolumesSnapshotsTestJSON-78747751-project Oct 04 03:29:33.409135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:29:33.409135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:29:33.409135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 0ce066d8dc8243bc9bb0b36250288677 Oct 04 03:29:33.409135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-VolumesSnapshotsTestJSON-78747751-project Oct 04 03:29:33.409135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: Oct 04 03:29:33.409135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.409135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '77f85157-47bd-4c94-a3bd-8bebbf68ca8c'} Oct 04 03:29:33.409135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. (HTTP 404) (Request-ID: req-7a9a035e-240e-4196-bea6-4f05436e0318) Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:33.409927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 03:29:33.411067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 03:29:33.412965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:29:33.414278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.414278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.414278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:29:33.414278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.414278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:29:33.414278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:29:33.414278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:29:33.414278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:29:33.414278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:29:33.414278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. Oct 04 03:29:33.414278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:29:33.414278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-466aee7c-ae5c-4d86-8fe1-b46971ed0644 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] Returning 404 to user: Volume 77f85157-47bd-4c94-a3bd-8bebbf68ca8c could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:29:33.414278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-466aee7c-ae5c-4d86-8fe1-b46971ed0644 tempest-VolumesSnapshotsTestJSON-78747751 tempest-VolumesSnapshotsTestJSON-78747751-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c" status: 404 len: 109 microversion: 2.1 time: 0.063887 Oct 04 03:29:33.415811 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 21/35] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Oct 4 03:29:33 2022] GET /compute/v2.1/os-volumes/77f85157-47bd-4c94-a3bd-8bebbf68ca8c => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 03:29:38.380214 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-92016c1b-f615-4b69-93ca-f88fcdc67ffa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Action: 'create', calling method: .version_select at 0x7f165c37c5e0>, body: {"keypair": {"name": "tempest-keypair-291350842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWAYVCE62ShwI7ECmryosgr/avsziS6ARU3btHJUodS2dmt+lpSAuRSkhhRabJ8XibYP9EJ8O2vm/v5NT5ntb9/TErd5UjzGBKt8YYqY1TpWLLVFsvajuApCk4XiuddNQ=="}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:29:38.577294 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-92016c1b-f615-4b69-93ca-f88fcdc67ffa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Getting quotas for project 96643b79b7724c398b1df29f9ea0bbd4. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:29:38.604886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-92016c1b-f615-4b69-93ca-f88fcdc67ffa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Getting quotas for user 542b137fb8cd4d25867d95a13d2cb651 and project 96643b79b7724c398b1df29f9ea0bbd4. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:29:38.755098 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-92016c1b-f615-4b69-93ca-f88fcdc67ffa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.184043 Oct 04 03:29:38.756801 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 15/36] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Oct 4 03:29:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1186 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 03:29:42.513428 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1498885145", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "networks": [{"uuid": "897a5445-30b8-418d-9bdf-3549eb6fc498"}]}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:29:42.794551 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.network.neutron [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] validate_networks() for [('897a5445-30b8-418d-9bdf-3549eb6fc498', None, None, None, None, None)] {{(pid=120595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:29:43.228932 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8fb11af4-92f1-49b0-8b32-3aed0bce2a2f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Action: 'create', calling method: .version_select at 0x7f165c2dcdc0>, body: {"keypair": {"name": "tempest-keypair-1101053467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoZonmc+anafBbtMNV355keBZxRx5ZrZoaXqkXS6+LMn7B5rqsqU9SVldo1eDsNdITpIIDynpaBsC3EEAJRwfd3xK9/rlLHChnP9wGdJGf8wsgiGi8EkUhBeeOrP+/jzw=="}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:29:43.286239 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-8fb11af4-92f1-49b0-8b32-3aed0bce2a2f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Getting quotas for project 2011dec80f764558a3a0fe210cdd0755. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:29:43.293112 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-8fb11af4-92f1-49b0-8b32-3aed0bce2a2f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Getting quotas for user 02f76bc3ab354c4a8e9941e1403274ae and project 2011dec80f764558a3a0fe210cdd0755. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:29:43.412865 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8fb11af4-92f1-49b0-8b32-3aed0bce2a2f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.824439 Oct 04 03:29:43.428814 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 16/37] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Oct 4 03:29:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:45.545532 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Flavor limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:29:45.546002 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Image limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:29:45.546359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Flavor pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:29:45.546779 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Image pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:29:45.547176 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:29:45.595942 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:45.598128 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:45.600727 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:45.604435 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:45.605158 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:45.605754 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:45.736053 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Getting quotas for project caaf5d7d94d442c28466101666bdcab0. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:29:45.769928 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Getting quotas for user 3e1b3303d5ca4f5e90176c05f35e70cd and project caaf5d7d94d442c28466101666bdcab0. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:29:45.810075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Going to run 1 instances... {{(pid=120595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:29:45.827579 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:29:46.083519 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-67c80dd5-df13-4249-806d-c08730a96b4e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.850930 Oct 04 03:29:46.088325 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 22/38] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:29:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 03:29:46.099966 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-dcbcf4b8-9d04-4368-8b33-8bb80497c86e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:46.101298 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-dcbcf4b8-9d04-4368-8b33-8bb80497c86e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:29:46.614390 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-dcbcf4b8-9d04-4368-8b33-8bb80497c86e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:46.661255 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-dcbcf4b8-9d04-4368-8b33-8bb80497c86e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1215 microversion: 2.1 time: 0.566506 Oct 04 03:29:46.666593 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 17/39] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:29:46 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1215 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:29:47.010821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-336923415", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff24145b-812c-4e90-8679-e40583d5898d"}], "security_groups": [{"name": "tempest-securitygroup--975273071"}], "key_name": "tempest-keypair-291350842", "user_data": "}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:29:47.658547 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.network.neutron [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] validate_networks() for [('ff24145b-812c-4e90-8679-e40583d5898d', None, None, None, None, None)] {{(pid=120595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:29:47.696454 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-61536ec1-ae2b-4e6a-bb30-9259d683cea2 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:47.698551 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-61536ec1-ae2b-4e6a-bb30-9259d683cea2 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:29:48.137763 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-61536ec1-ae2b-4e6a-bb30-9259d683cea2 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:48.150252 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-61536ec1-ae2b-4e6a-bb30-9259d683cea2 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1215 microversion: 2.1 time: 0.460424 Oct 04 03:29:48.150900 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 18/40] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:29:47 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1215 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:29:48.834387 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d76a9742-2e6e-48ae-8970-700d20f9f417 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Action: 'create', calling method: .version_select at 0x7f165cd55820>, body: {"keypair": {"name": "tempest-keypair-2053772902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdDRfYI/xhDPop9WvEDRnLJ0oy+feTfmchbwvyd4KiBIferbtUiC5e8aAubzzPJ2dnUBE/rfdBGnyIlbb1fg29+fCsDvkfeVXf80A+yN8DkaIU7daQE9qJJLRX9FBD9Qw=="}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:29:48.874511 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-d76a9742-2e6e-48ae-8970-700d20f9f417 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:29:48.888778 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-d76a9742-2e6e-48ae-8970-700d20f9f417 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for user b8795829c34046628cae345dd4d45e75 and project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:29:48.946586 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d76a9742-2e6e-48ae-8970-700d20f9f417 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.431970 Oct 04 03:29:48.947816 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 19/41] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Oct 4 03:29:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:29:49.185102 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9af29c64-d317-4046-a7c5-570989d7fda2 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:49.187709 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9af29c64-d317-4046-a7c5-570989d7fda2 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:29:49.223063 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9af29c64-d317-4046-a7c5-570989d7fda2 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:49.226149 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9af29c64-d317-4046-a7c5-570989d7fda2 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:49.228077 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9af29c64-d317-4046-a7c5-570989d7fda2 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:49.229655 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9af29c64-d317-4046-a7c5-570989d7fda2 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:49.231353 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9af29c64-d317-4046-a7c5-570989d7fda2 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:49.236071 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9af29c64-d317-4046-a7c5-570989d7fda2 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:49.657611 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9af29c64-d317-4046-a7c5-570989d7fda2 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:49.691458 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9af29c64-d317-4046-a7c5-570989d7fda2 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1267 microversion: 2.1 time: 0.520745 Oct 04 03:29:49.691714 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 20/42] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:29:49 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1267 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:29:49.900954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Flavor limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:29:49.901457 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Image limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:29:49.901839 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Flavor pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:29:49.902253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Image pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:29:49.902684 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:29:49.925682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:49.926171 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:49.934349 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:49.942445 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:49.944671 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:49.945145 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:50.010641 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Getting quotas for project 96643b79b7724c398b1df29f9ea0bbd4. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:29:50.025409 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Getting quotas for user 542b137fb8cd4d25867d95a13d2cb651 and project 96643b79b7724c398b1df29f9ea0bbd4. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:29:50.059249 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Going to run 1 instances... {{(pid=120595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:29:50.066132 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:29:50.197085 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-33f59dd0-b208-486f-8860-3d9b5095f1e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.193330 Oct 04 03:29:50.201316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 23/43] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Oct 4 03:29:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 3198 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 03:29:50.211505 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1ffbbec9-2fa7-4695-8076-21d2af95e8bc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:50.213001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1ffbbec9-2fa7-4695-8076-21d2af95e8bc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:29:50.587510 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1ffbbec9-2fa7-4695-8076-21d2af95e8bc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:50.600363 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1ffbbec9-2fa7-4695-8076-21d2af95e8bc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:50.607292 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1ffbbec9-2fa7-4695-8076-21d2af95e8bc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:50.612962 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1ffbbec9-2fa7-4695-8076-21d2af95e8bc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1280 microversion: 2.20 time: 0.406889 Oct 04 03:29:50.638966 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 21/44] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:29:50 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1280 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:29:50.650906 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-456606065", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:29:50.720488 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8f24b47d-104d-4918-a5e5-e304c95c6901 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:50.721190 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8f24b47d-104d-4918-a5e5-e304c95c6901 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:29:50.733355 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8f24b47d-104d-4918-a5e5-e304c95c6901 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:50.733848 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8f24b47d-104d-4918-a5e5-e304c95c6901 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:50.739361 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8f24b47d-104d-4918-a5e5-e304c95c6901 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:50.743037 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8f24b47d-104d-4918-a5e5-e304c95c6901 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:50.756738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8f24b47d-104d-4918-a5e5-e304c95c6901 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:50.758062 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8f24b47d-104d-4918-a5e5-e304c95c6901 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:50.788357 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.network.neutron [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] validate_networks() for [('053cc780-a24b-4a11-8b58-f28b74a4a8ee', None, None, None, None, None)] {{(pid=120595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:29:51.794305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-8f24b47d-104d-4918-a5e5-e304c95c6901 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:51.809838 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8f24b47d-104d-4918-a5e5-e304c95c6901 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1273 microversion: 2.1 time: 1.094221 Oct 04 03:29:51.829394 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 22/45] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:29:50 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1273 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:29:51.841390 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-57fd8e62-481f-4b05-aada-21381fab6937 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:51.842131 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-57fd8e62-481f-4b05-aada-21381fab6937 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:29:52.318565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-57fd8e62-481f-4b05-aada-21381fab6937 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:52.331269 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-57fd8e62-481f-4b05-aada-21381fab6937 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:52.340279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-57fd8e62-481f-4b05-aada-21381fab6937 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:52.343525 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-57fd8e62-481f-4b05-aada-21381fab6937 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1280 microversion: 2.20 time: 0.510052 Oct 04 03:29:52.346606 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:29:51 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1280 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:29:52.841498 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e680bdf2-25c2-4ec0-aa48-00678ca746ba tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:52.842146 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e680bdf2-25c2-4ec0-aa48-00678ca746ba tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:29:52.852971 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e680bdf2-25c2-4ec0-aa48-00678ca746ba tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:52.854684 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e680bdf2-25c2-4ec0-aa48-00678ca746ba tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:52.855159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e680bdf2-25c2-4ec0-aa48-00678ca746ba tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:52.857084 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e680bdf2-25c2-4ec0-aa48-00678ca746ba tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:52.858571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e680bdf2-25c2-4ec0-aa48-00678ca746ba tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:52.859058 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e680bdf2-25c2-4ec0-aa48-00678ca746ba tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:54.473260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e680bdf2-25c2-4ec0-aa48-00678ca746ba tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:54.486315 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e680bdf2-25c2-4ec0-aa48-00678ca746ba tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1315 microversion: 2.1 time: 1.650632 Oct 04 03:29:54.487853 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 24/47] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:29:52 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1315 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:29:54.498757 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bf89f5ae-71a0-4e68-835c-0262b9fbc736 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:54.500708 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bf89f5ae-71a0-4e68-835c-0262b9fbc736 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:29:54.517563 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf89f5ae-71a0-4e68-835c-0262b9fbc736 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:54.526590 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf89f5ae-71a0-4e68-835c-0262b9fbc736 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:54.527143 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf89f5ae-71a0-4e68-835c-0262b9fbc736 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:54.530793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf89f5ae-71a0-4e68-835c-0262b9fbc736 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:54.531313 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf89f5ae-71a0-4e68-835c-0262b9fbc736 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:54.531784 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf89f5ae-71a0-4e68-835c-0262b9fbc736 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:55.088598 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-bf89f5ae-71a0-4e68-835c-0262b9fbc736 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:55.122735 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-bf89f5ae-71a0-4e68-835c-0262b9fbc736 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:55.130918 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-bf89f5ae-71a0-4e68-835c-0262b9fbc736 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:55.136368 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bf89f5ae-71a0-4e68-835c-0262b9fbc736 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1338 microversion: 2.20 time: 0.644602 Oct 04 03:29:55.164315 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 25/48] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:29:54 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1338 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:29:55.212198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-58212940", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5746e31-b69a-42a2-90cf-dfad137d2069"}], "security_groups": [{"name": "tempest-securitygroup--2062087097"}], "key_name": "tempest-keypair-1101053467", "user_data": "}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:29:55.854470 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Flavor limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:29:55.855522 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Image limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:29:55.856477 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Flavor pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:29:55.856959 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Image pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:29:55.857378 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:29:55.901713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:55.903316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:55.903835 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:55.904607 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:55.909248 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:55.910232 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:55.988469 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Getting quotas for project b62fd4925f3840edb9806630cd78c9fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:29:56.008745 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Getting quotas for user a267cf7109c64f538824c162fedd084b and project b62fd4925f3840edb9806630cd78c9fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:29:56.066576 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Going to run 1 instances... {{(pid=120595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:29:56.078052 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:29:56.207107 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] validate_networks() for [('c5746e31-b69a-42a2-90cf-dfad137d2069', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:29:56.213626 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-cecead84-d658-4138-a856-92c93dfef181 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.734618 Oct 04 03:29:56.214941 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:29:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 5737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 03:29:56.220489 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2e7d7e50-ce24-4267-9e0f-e1cdcb325388 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:56.221679 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-2e7d7e50-ce24-4267-9e0f-e1cdcb325388 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:29:56.268458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2e7d7e50-ce24-4267-9e0f-e1cdcb325388 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:56.278032 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2e7d7e50-ce24-4267-9e0f-e1cdcb325388 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:56.278827 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2e7d7e50-ce24-4267-9e0f-e1cdcb325388 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:56.283751 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2e7d7e50-ce24-4267-9e0f-e1cdcb325388 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:56.284610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2e7d7e50-ce24-4267-9e0f-e1cdcb325388 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:56.289423 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2e7d7e50-ce24-4267-9e0f-e1cdcb325388 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:57.529888 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-2e7d7e50-ce24-4267-9e0f-e1cdcb325388 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:57.567128 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2e7d7e50-ce24-4267-9e0f-e1cdcb325388 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1315 microversion: 2.1 time: 1.350767 Oct 04 03:29:57.569685 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 25/50] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:29:56 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1315 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:29:57.576642 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7cdf9c58-146c-4b06-ac1e-175424531a50 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:57.579600 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-7cdf9c58-146c-4b06-ac1e-175424531a50 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:29:57.590838 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7cdf9c58-146c-4b06-ac1e-175424531a50 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:57.594214 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7cdf9c58-146c-4b06-ac1e-175424531a50 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:57.594919 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7cdf9c58-146c-4b06-ac1e-175424531a50 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:57.596565 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7cdf9c58-146c-4b06-ac1e-175424531a50 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:57.597983 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7cdf9c58-146c-4b06-ac1e-175424531a50 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:57.599239 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7cdf9c58-146c-4b06-ac1e-175424531a50 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:57.836010 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7cdf9c58-146c-4b06-ac1e-175424531a50 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:57.850939 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7cdf9c58-146c-4b06-ac1e-175424531a50 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:57.855287 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7cdf9c58-146c-4b06-ac1e-175424531a50 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:57.873201 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-7cdf9c58-146c-4b06-ac1e-175424531a50 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1338 microversion: 2.20 time: 0.300911 Oct 04 03:29:57.874246 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 26/51] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:29:57 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1338 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:29:57.878910 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-ab175865-531a-4e2b-90a6-4b5f7843db63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:57.896587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-ab175865-531a-4e2b-90a6-4b5f7843db63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:29:57.902968 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ab175865-531a-4e2b-90a6-4b5f7843db63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:57.903735 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ab175865-531a-4e2b-90a6-4b5f7843db63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:57.904332 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ab175865-531a-4e2b-90a6-4b5f7843db63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:57.907384 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ab175865-531a-4e2b-90a6-4b5f7843db63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:57.912177 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ab175865-531a-4e2b-90a6-4b5f7843db63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:57.912883 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ab175865-531a-4e2b-90a6-4b5f7843db63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:58.179195 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-ab175865-531a-4e2b-90a6-4b5f7843db63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:29:58.197115 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-ab175865-531a-4e2b-90a6-4b5f7843db63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1225 microversion: 2.1 time: 0.321665 Oct 04 03:29:58.198385 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 27/52] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:29:57 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1225 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:29:58.597933 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e8c17f53-3309-454a-8c7b-2a51b527e22e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:29:58.598591 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e8c17f53-3309-454a-8c7b-2a51b527e22e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:29:58.613300 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e8c17f53-3309-454a-8c7b-2a51b527e22e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:58.613794 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e8c17f53-3309-454a-8c7b-2a51b527e22e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:58.614235 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e8c17f53-3309-454a-8c7b-2a51b527e22e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:58.626145 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e8c17f53-3309-454a-8c7b-2a51b527e22e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:58.627666 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e8c17f53-3309-454a-8c7b-2a51b527e22e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:58.628827 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e8c17f53-3309-454a-8c7b-2a51b527e22e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:59.768646 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:29:59.770291 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:29:59.772535 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:29:59.773240 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:29:59.775671 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:29:59.798656 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:59.802372 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:59.803138 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:59.804734 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:29:59.805457 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:29:59.806106 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:29:59.860947 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Getting quotas for project 2011dec80f764558a3a0fe210cdd0755. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:29:59.866613 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Getting quotas for user 02f76bc3ab354c4a8e9941e1403274ae and project 2011dec80f764558a3a0fe210cdd0755. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:29:59.879545 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:29:59.891885 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:30:00.051782 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c37665f9-7ab4-4e2d-b9a2-3ab0c80eadaa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.884179 Oct 04 03:30:00.063696 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 26/53] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:29:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 4898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 03:30:00.070914 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1975818452", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:00.173468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e8c17f53-3309-454a-8c7b-2a51b527e22e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:00.184950 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e8c17f53-3309-454a-8c7b-2a51b527e22e tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1315 microversion: 2.1 time: 1.591627 Oct 04 03:30:00.198721 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 28/54] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:29:58 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1315 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:00.207800 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] validate_networks() for [('053cc780-a24b-4a11-8b58-f28b74a4a8ee', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:30:00.218635 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-950df1c6-85c1-4c2a-b321-cf140e66a44c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:00.223357 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-950df1c6-85c1-4c2a-b321-cf140e66a44c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:00.238877 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-950df1c6-85c1-4c2a-b321-cf140e66a44c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:00.240104 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-950df1c6-85c1-4c2a-b321-cf140e66a44c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:00.240731 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-950df1c6-85c1-4c2a-b321-cf140e66a44c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:00.241539 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-950df1c6-85c1-4c2a-b321-cf140e66a44c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:00.242217 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-950df1c6-85c1-4c2a-b321-cf140e66a44c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:00.242845 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-950df1c6-85c1-4c2a-b321-cf140e66a44c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:00.641146 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-950df1c6-85c1-4c2a-b321-cf140e66a44c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:00.652075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-950df1c6-85c1-4c2a-b321-cf140e66a44c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:00.656998 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-950df1c6-85c1-4c2a-b321-cf140e66a44c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:00.659407 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-950df1c6-85c1-4c2a-b321-cf140e66a44c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1405 microversion: 2.20 time: 0.459368 Oct 04 03:30:00.672612 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 29/55] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:30:00 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:30:00.677656 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-8df90e28-4202-4fba-8ff9-9a2030875aa5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:00.678549 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-8df90e28-4202-4fba-8ff9-9a2030875aa5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:00.954994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-8df90e28-4202-4fba-8ff9-9a2030875aa5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:00.995336 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-8df90e28-4202-4fba-8ff9-9a2030875aa5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1236 microversion: 2.1 time: 0.321381 Oct 04 03:30:01.006363 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 30/56] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:00 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1236 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:01.519595 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-bf9cf5df-e267-4d14-9673-7157328ecdbf req-71b26a97-7e80-4aa9-93bb-b6ca41beae1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb818d91-3d4e-47d8-8f9f-05296ee3f350", "tag": "d97fb947-abe0-495b-b10d-df45d3a61b91"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:01.630080 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-bf9cf5df-e267-4d14-9673-7157328ecdbf req-71b26a97-7e80-4aa9-93bb-b6ca41beae1f service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:01.635072 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-bf9cf5df-e267-4d14-9673-7157328ecdbf req-71b26a97-7e80-4aa9-93bb-b6ca41beae1f service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:01.639229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-bf9cf5df-e267-4d14-9673-7157328ecdbf req-71b26a97-7e80-4aa9-93bb-b6ca41beae1f service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:01.795006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-bf9cf5df-e267-4d14-9673-7157328ecdbf req-71b26a97-7e80-4aa9-93bb-b6ca41beae1f service nova] Creating event network-changed:d97fb947-abe0-495b-b10d-df45d3a61b91 for instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 on hv-cinder-84914 Oct 04 03:30:01.798248 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-bf9cf5df-e267-4d14-9673-7157328ecdbf req-71b26a97-7e80-4aa9-93bb-b6ca41beae1f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 03:30:01.808083 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-bf9cf5df-e267-4d14-9673-7157328ecdbf req-71b26a97-7e80-4aa9-93bb-b6ca41beae1f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 03:30:01.820752 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-63e48412-162a-4acb-a0ee-adfa0fcfeb91 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:01.821241 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-63e48412-162a-4acb-a0ee-adfa0fcfeb91 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:01.830174 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-63e48412-162a-4acb-a0ee-adfa0fcfeb91 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:01.832538 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-63e48412-162a-4acb-a0ee-adfa0fcfeb91 None None] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:01.838336 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-63e48412-162a-4acb-a0ee-adfa0fcfeb91 None None] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:01.840151 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-63e48412-162a-4acb-a0ee-adfa0fcfeb91 None None] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:01.861039 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:30:01.861039 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:30:01.863498 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:30:01.865481 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:30:01.866376 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:30:01.902832 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.compute.rpcapi [None req-63e48412-162a-4acb-a0ee-adfa0fcfeb91 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 03:30:01.904055 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-63e48412-162a-4acb-a0ee-adfa0fcfeb91 None None] Releasing lock "compute-rpcapi-router" {{(pid=120595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 03:30:01.919998 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:01.920773 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:01.922193 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:01.924687 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:01.927729 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:01.927729 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:01.933966 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-63e48412-162a-4acb-a0ee-adfa0fcfeb91 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.915344 Oct 04 03:30:01.941275 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 31/57] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:01.957138 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2415ac20-da38-4165-9a46-6ff7713ada44 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:01.963541 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-2415ac20-da38-4165-9a46-6ff7713ada44 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:02.023192 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2415ac20-da38-4165-9a46-6ff7713ada44 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:02.023745 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2415ac20-da38-4165-9a46-6ff7713ada44 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:02.027353 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2415ac20-da38-4165-9a46-6ff7713ada44 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:02.030458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2415ac20-da38-4165-9a46-6ff7713ada44 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:02.030971 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2415ac20-da38-4165-9a46-6ff7713ada44 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:02.034318 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2415ac20-da38-4165-9a46-6ff7713ada44 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:02.048807 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Getting quotas for project b62fd4925f3840edb9806630cd78c9fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:30:02.087190 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Getting quotas for user a267cf7109c64f538824c162fedd084b and project b62fd4925f3840edb9806630cd78c9fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:30:02.138711 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:30:02.147079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:30:02.335402 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5a94402e-14c4-48ed-9904-a71d5a8913e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.268836 Oct 04 03:30:02.335738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 27/58] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:30:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 03:30:02.347679 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0a540d4b-dcd8-4d90-b6b6-b8b02c6c975e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:02.348497 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0a540d4b-dcd8-4d90-b6b6-b8b02c6c975e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:02.374850 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a540d4b-dcd8-4d90-b6b6-b8b02c6c975e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:02.375526 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a540d4b-dcd8-4d90-b6b6-b8b02c6c975e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:02.377868 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a540d4b-dcd8-4d90-b6b6-b8b02c6c975e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:02.378500 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a540d4b-dcd8-4d90-b6b6-b8b02c6c975e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:02.378976 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a540d4b-dcd8-4d90-b6b6-b8b02c6c975e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:02.379414 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a540d4b-dcd8-4d90-b6b6-b8b02c6c975e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:02.665516 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-2415ac20-da38-4165-9a46-6ff7713ada44 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:02.701872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2415ac20-da38-4165-9a46-6ff7713ada44 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1315 microversion: 2.1 time: 0.758637 Oct 04 03:30:02.705834 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 32/59] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:01 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:02.721509 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-1a1bb962-3a02-4e94-83d2-dd86ad39a6f4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:02.722479 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-1a1bb962-3a02-4e94-83d2-dd86ad39a6f4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:02.732748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1a1bb962-3a02-4e94-83d2-dd86ad39a6f4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:02.733331 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1a1bb962-3a02-4e94-83d2-dd86ad39a6f4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:02.733783 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1a1bb962-3a02-4e94-83d2-dd86ad39a6f4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:02.734612 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1a1bb962-3a02-4e94-83d2-dd86ad39a6f4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:02.735074 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1a1bb962-3a02-4e94-83d2-dd86ad39a6f4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:02.735512 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1a1bb962-3a02-4e94-83d2-dd86ad39a6f4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:03.060678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-1a1bb962-3a02-4e94-83d2-dd86ad39a6f4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:03.072029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-1a1bb962-3a02-4e94-83d2-dd86ad39a6f4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1288 microversion: 2.1 time: 0.364805 Oct 04 03:30:03.077222 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 33/60] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:02 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1288 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:03.093557 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1625677026", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "86d4958b-fe69-4a74-b4b0-c186c2f360dd"}], "security_groups": [{"name": "tempest-securitygroup--1408731237"}], "key_name": "tempest-keypair-2053772902", "user_data": "}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:03.317564 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-0a540d4b-dcd8-4d90-b6b6-b8b02c6c975e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:03.332675 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-0a540d4b-dcd8-4d90-b6b6-b8b02c6c975e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:03.338099 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-0a540d4b-dcd8-4d90-b6b6-b8b02c6c975e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:03.343777 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0a540d4b-dcd8-4d90-b6b6-b8b02c6c975e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1405 microversion: 2.20 time: 1.002787 Oct 04 03:30:03.345645 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 28/61] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:30:02 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1405 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:30:03.351642 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5df46f16-767d-41a4-88f3-628d2e1447ab tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:03.370880 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5df46f16-767d-41a4-88f3-628d2e1447ab tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:03.392696 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:03.535153 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.network.neutron [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] validate_networks() for [('86d4958b-fe69-4a74-b4b0-c186c2f360dd', None, None, None, None, None)] {{(pid=120595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:30:03.901450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5df46f16-767d-41a4-88f3-628d2e1447ab tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:03.908713 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5df46f16-767d-41a4-88f3-628d2e1447ab tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1222 microversion: 2.1 time: 0.561311 Oct 04 03:30:03.914621 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 29/62] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:03 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1222 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:03.926064 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-aba22e1c-a81c-4a5c-84d3-70a48a3427c6 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:03.927717 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-aba22e1c-a81c-4a5c-84d3-70a48a3427c6 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:03.952771 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aba22e1c-a81c-4a5c-84d3-70a48a3427c6 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:03.955943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aba22e1c-a81c-4a5c-84d3-70a48a3427c6 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:03.956717 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aba22e1c-a81c-4a5c-84d3-70a48a3427c6 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:03.960573 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aba22e1c-a81c-4a5c-84d3-70a48a3427c6 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:03.961767 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aba22e1c-a81c-4a5c-84d3-70a48a3427c6 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:03.962997 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aba22e1c-a81c-4a5c-84d3-70a48a3427c6 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:04.693578 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-aba22e1c-a81c-4a5c-84d3-70a48a3427c6 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:04.737365 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-aba22e1c-a81c-4a5c-84d3-70a48a3427c6 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1315 microversion: 2.1 time: 0.821266 Oct 04 03:30:04.744141 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 30/63] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:03 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1315 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:04.759162 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2552a6ae-e3c2-42c4-ab74-c3ebf9300137 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:04.759884 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2552a6ae-e3c2-42c4-ab74-c3ebf9300137 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:04.795692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2552a6ae-e3c2-42c4-ab74-c3ebf9300137 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:04.796743 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2552a6ae-e3c2-42c4-ab74-c3ebf9300137 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:04.799654 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2552a6ae-e3c2-42c4-ab74-c3ebf9300137 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:04.803342 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2552a6ae-e3c2-42c4-ab74-c3ebf9300137 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:04.805755 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2552a6ae-e3c2-42c4-ab74-c3ebf9300137 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:04.807765 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2552a6ae-e3c2-42c4-ab74-c3ebf9300137 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:05.087677 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2552a6ae-e3c2-42c4-ab74-c3ebf9300137 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:05.109222 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2552a6ae-e3c2-42c4-ab74-c3ebf9300137 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1294 microversion: 2.1 time: 0.363738 Oct 04 03:30:05.128248 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 31/64] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:04 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1294 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:05.142893 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fcfe2699-67b9-45e7-b8ab-97432cb6f924 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:05.143725 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-fcfe2699-67b9-45e7-b8ab-97432cb6f924 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:05.155138 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2699-67b9-45e7-b8ab-97432cb6f924 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:05.161767 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2699-67b9-45e7-b8ab-97432cb6f924 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:05.162454 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2699-67b9-45e7-b8ab-97432cb6f924 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:05.165412 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2699-67b9-45e7-b8ab-97432cb6f924 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:05.166074 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2699-67b9-45e7-b8ab-97432cb6f924 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:05.166659 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2699-67b9-45e7-b8ab-97432cb6f924 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:05.528547 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-fcfe2699-67b9-45e7-b8ab-97432cb6f924 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:05.539378 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-fcfe2699-67b9-45e7-b8ab-97432cb6f924 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:05.541127 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-fcfe2699-67b9-45e7-b8ab-97432cb6f924 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:05.542523 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-fcfe2699-67b9-45e7-b8ab-97432cb6f924 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1405 microversion: 2.20 time: 0.410200 Oct 04 03:30:05.543886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:30:05 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:30:05.548784 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5602bd8f-3b03-4fae-b689-3fb611c7d0c3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:05.549601 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5602bd8f-3b03-4fae-b689-3fb611c7d0c3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:05.557648 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5602bd8f-3b03-4fae-b689-3fb611c7d0c3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:05.561167 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5602bd8f-3b03-4fae-b689-3fb611c7d0c3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:05.561809 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5602bd8f-3b03-4fae-b689-3fb611c7d0c3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:05.562887 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5602bd8f-3b03-4fae-b689-3fb611c7d0c3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:05.563649 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5602bd8f-3b03-4fae-b689-3fb611c7d0c3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:05.565755 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5602bd8f-3b03-4fae-b689-3fb611c7d0c3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:05.683399 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5602bd8f-3b03-4fae-b689-3fb611c7d0c3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:05.701919 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5602bd8f-3b03-4fae-b689-3fb611c7d0c3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1274 microversion: 2.1 time: 0.156667 Oct 04 03:30:05.720578 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 33/66] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:05 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1274 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:05.770195 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6ba3dcbf-1c19-4276-be9a-56f4708724af tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:05.772757 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6ba3dcbf-1c19-4276-be9a-56f4708724af tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:05.798051 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ba3dcbf-1c19-4276-be9a-56f4708724af tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:05.800358 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ba3dcbf-1c19-4276-be9a-56f4708724af tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:05.804104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ba3dcbf-1c19-4276-be9a-56f4708724af tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:05.804664 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ba3dcbf-1c19-4276-be9a-56f4708724af tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:05.805897 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ba3dcbf-1c19-4276-be9a-56f4708724af tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:05.807221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ba3dcbf-1c19-4276-be9a-56f4708724af tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:05.887688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Flavor limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:30:05.888519 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Image limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:30:05.888718 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Flavor pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:30:05.889004 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Image pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:30:05.889685 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:30:05.916892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:05.917398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:05.917799 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:05.918525 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:05.918969 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:05.919386 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:05.988664 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:30:06.009813 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for user b8795829c34046628cae345dd4d45e75 and project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:30:06.055826 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Going to run 1 instances... {{(pid=120595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:30:06.067062 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:30:06.191578 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-92731961-23f1-441d-bb24-aba21eaeb096 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.112980 Oct 04 03:30:06.196752 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 34/67] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:30:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 3119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 03:30:06.211183 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-84edd7fc-2009-49d7-9b38-804e50526ace tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:06.213259 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-84edd7fc-2009-49d7-9b38-804e50526ace tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:06.231127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-84edd7fc-2009-49d7-9b38-804e50526ace tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:06.234796 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-84edd7fc-2009-49d7-9b38-804e50526ace tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:06.235515 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-84edd7fc-2009-49d7-9b38-804e50526ace tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:06.238133 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-84edd7fc-2009-49d7-9b38-804e50526ace tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:06.238979 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-84edd7fc-2009-49d7-9b38-804e50526ace tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:06.242713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-84edd7fc-2009-49d7-9b38-804e50526ace tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:07.316220 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-84edd7fc-2009-49d7-9b38-804e50526ace tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:07.330818 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-84edd7fc-2009-49d7-9b38-804e50526ace tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1294 microversion: 2.1 time: 1.132569 Oct 04 03:30:07.374720 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 35/68] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:06 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1294 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:07.398637 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c84aff5f-5d9f-4f5c-bb35-aa1ba1467cd9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:07.399257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c84aff5f-5d9f-4f5c-bb35-aa1ba1467cd9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:08.117189 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c84aff5f-5d9f-4f5c-bb35-aa1ba1467cd9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:08.128842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c84aff5f-5d9f-4f5c-bb35-aa1ba1467cd9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1242 microversion: 2.1 time: 0.745455 Oct 04 03:30:08.130610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 36/69] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:07 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1242 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:08.136654 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-15c93220-8e46-4217-a559-83aefeafc998 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:08.137739 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-15c93220-8e46-4217-a559-83aefeafc998 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:08.146064 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-15c93220-8e46-4217-a559-83aefeafc998 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:08.146835 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-15c93220-8e46-4217-a559-83aefeafc998 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:08.147726 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-15c93220-8e46-4217-a559-83aefeafc998 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:08.149813 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-15c93220-8e46-4217-a559-83aefeafc998 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:08.150468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-15c93220-8e46-4217-a559-83aefeafc998 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:08.151188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-15c93220-8e46-4217-a559-83aefeafc998 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:08.200266 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6ba3dcbf-1c19-4276-be9a-56f4708724af tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:08.208188 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6ba3dcbf-1c19-4276-be9a-56f4708724af tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1315 microversion: 2.1 time: 2.442286 Oct 04 03:30:08.208780 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 34/70] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:05 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1315 bytes in 2444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:30:08.228516 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ac21b936-dd87-45af-a86e-6116b82920f3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:08.229131 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ac21b936-dd87-45af-a86e-6116b82920f3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:08.259687 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ac21b936-dd87-45af-a86e-6116b82920f3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:08.260098 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ac21b936-dd87-45af-a86e-6116b82920f3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:08.262065 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ac21b936-dd87-45af-a86e-6116b82920f3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:08.268405 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ac21b936-dd87-45af-a86e-6116b82920f3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:08.269064 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ac21b936-dd87-45af-a86e-6116b82920f3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:08.269650 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ac21b936-dd87-45af-a86e-6116b82920f3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:08.548944 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ac21b936-dd87-45af-a86e-6116b82920f3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:08.557759 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ac21b936-dd87-45af-a86e-6116b82920f3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1280 microversion: 2.1 time: 0.340574 Oct 04 03:30:08.560927 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 35/71] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:08 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1280 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:08.573790 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-852dadca-a8f9-411d-8aba-1be4c9db999e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:08.575007 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-852dadca-a8f9-411d-8aba-1be4c9db999e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:08.593428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-852dadca-a8f9-411d-8aba-1be4c9db999e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:08.594993 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-852dadca-a8f9-411d-8aba-1be4c9db999e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:08.600860 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-852dadca-a8f9-411d-8aba-1be4c9db999e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:08.600860 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-852dadca-a8f9-411d-8aba-1be4c9db999e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:08.600860 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-852dadca-a8f9-411d-8aba-1be4c9db999e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:08.600860 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-852dadca-a8f9-411d-8aba-1be4c9db999e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:08.790898 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-852dadca-a8f9-411d-8aba-1be4c9db999e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:08.800744 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-852dadca-a8f9-411d-8aba-1be4c9db999e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1294 microversion: 2.1 time: 0.237375 Oct 04 03:30:08.815794 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 36/72] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:08 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1294 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:08.823841 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-9bc64275-a04d-4b8d-a9cf-d4c0c76e69a9 req-207251a7-af97-4907-ae1b-bd191c29f988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f680f852-0ad9-4478-912f-1821b7755927", "tag": "b303180f-7432-4f63-b46d-6cc9c707c0d6"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:08.842960 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9bc64275-a04d-4b8d-a9cf-d4c0c76e69a9 req-207251a7-af97-4907-ae1b-bd191c29f988 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:08.843448 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9bc64275-a04d-4b8d-a9cf-d4c0c76e69a9 req-207251a7-af97-4907-ae1b-bd191c29f988 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:08.844073 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9bc64275-a04d-4b8d-a9cf-d4c0c76e69a9 req-207251a7-af97-4907-ae1b-bd191c29f988 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:08.868315 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-9bc64275-a04d-4b8d-a9cf-d4c0c76e69a9 req-207251a7-af97-4907-ae1b-bd191c29f988 service nova] Creating event network-changed:b303180f-7432-4f63-b46d-6cc9c707c0d6 for instance f680f852-0ad9-4478-912f-1821b7755927 on hv-cinder-84914 Oct 04 03:30:08.868843 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9bc64275-a04d-4b8d-a9cf-d4c0c76e69a9 req-207251a7-af97-4907-ae1b-bd191c29f988 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 03:30:08.869644 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9bc64275-a04d-4b8d-a9cf-d4c0c76e69a9 req-207251a7-af97-4907-ae1b-bd191c29f988 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 03:30:08.870867 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3e88fdc7-29a9-4d97-aec7-f10f503ad10a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:08.871647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3e88fdc7-29a9-4d97-aec7-f10f503ad10a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:08.872425 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3e88fdc7-29a9-4d97-aec7-f10f503ad10a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:08.873351 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3e88fdc7-29a9-4d97-aec7-f10f503ad10a None None] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:08.874000 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3e88fdc7-29a9-4d97-aec7-f10f503ad10a None None] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:08.874675 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3e88fdc7-29a9-4d97-aec7-f10f503ad10a None None] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:08.886122 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.compute.rpcapi [None req-3e88fdc7-29a9-4d97-aec7-f10f503ad10a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 03:30:08.887650 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3e88fdc7-29a9-4d97-aec7-f10f503ad10a None None] Releasing lock "compute-rpcapi-router" {{(pid=120594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 03:30:08.909870 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3e88fdc7-29a9-4d97-aec7-f10f503ad10a None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092475 Oct 04 03:30:08.910487 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 37/73] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:08.945067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-15c93220-8e46-4217-a559-83aefeafc998 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:08.957612 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-15c93220-8e46-4217-a559-83aefeafc998 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:08.959401 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-15c93220-8e46-4217-a559-83aefeafc998 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:08.961132 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-15c93220-8e46-4217-a559-83aefeafc998 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1405 microversion: 2.20 time: 0.828241 Oct 04 03:30:08.962437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 37/74] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:30:08 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1405 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:30:09.158907 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c3f39e91-06a2-4de6-966b-1bceaa4fe40b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:09.159672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c3f39e91-06a2-4de6-966b-1bceaa4fe40b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:09.167700 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c3f39e91-06a2-4de6-966b-1bceaa4fe40b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:09.168480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c3f39e91-06a2-4de6-966b-1bceaa4fe40b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:09.169118 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c3f39e91-06a2-4de6-966b-1bceaa4fe40b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:09.170079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c3f39e91-06a2-4de6-966b-1bceaa4fe40b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:09.170707 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c3f39e91-06a2-4de6-966b-1bceaa4fe40b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:09.171311 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c3f39e91-06a2-4de6-966b-1bceaa4fe40b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:09.231640 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e81ea760-eee0-4b6a-aec9-bba86a595090 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:09.232254 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e81ea760-eee0-4b6a-aec9-bba86a595090 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:09.238497 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e81ea760-eee0-4b6a-aec9-bba86a595090 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:09.240215 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e81ea760-eee0-4b6a-aec9-bba86a595090 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:09.240874 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e81ea760-eee0-4b6a-aec9-bba86a595090 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:09.241808 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e81ea760-eee0-4b6a-aec9-bba86a595090 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:09.242473 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e81ea760-eee0-4b6a-aec9-bba86a595090 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:09.243079 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e81ea760-eee0-4b6a-aec9-bba86a595090 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:09.291346 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c3f39e91-06a2-4de6-966b-1bceaa4fe40b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:09.303401 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c3f39e91-06a2-4de6-966b-1bceaa4fe40b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1294 microversion: 2.1 time: 0.149274 Oct 04 03:30:09.308335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 38/75] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:09 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1294 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:09.593096 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-65bbb7a5-c126-4b2d-84e8-9a8cd9ed69d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:09.594028 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-65bbb7a5-c126-4b2d-84e8-9a8cd9ed69d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:09.608013 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-65bbb7a5-c126-4b2d-84e8-9a8cd9ed69d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:09.615455 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-65bbb7a5-c126-4b2d-84e8-9a8cd9ed69d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:09.616109 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-65bbb7a5-c126-4b2d-84e8-9a8cd9ed69d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:09.617030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-65bbb7a5-c126-4b2d-84e8-9a8cd9ed69d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:09.617587 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-65bbb7a5-c126-4b2d-84e8-9a8cd9ed69d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:09.618107 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-65bbb7a5-c126-4b2d-84e8-9a8cd9ed69d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:09.806206 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e81ea760-eee0-4b6a-aec9-bba86a595090 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:09.818505 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e81ea760-eee0-4b6a-aec9-bba86a595090 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1315 microversion: 2.1 time: 0.590181 Oct 04 03:30:09.822356 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 38/76] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:09 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:09.840669 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-26c4e9fa-6a7a-491e-ac75-229cd7a9ca79 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:09.841497 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-26c4e9fa-6a7a-491e-ac75-229cd7a9ca79 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:09.856332 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:09.873636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-26c4e9fa-6a7a-491e-ac75-229cd7a9ca79 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:09.874140 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-26c4e9fa-6a7a-491e-ac75-229cd7a9ca79 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:09.877385 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-26c4e9fa-6a7a-491e-ac75-229cd7a9ca79 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:09.878119 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-26c4e9fa-6a7a-491e-ac75-229cd7a9ca79 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:09.878581 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-26c4e9fa-6a7a-491e-ac75-229cd7a9ca79 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:09.879010 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-26c4e9fa-6a7a-491e-ac75-229cd7a9ca79 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:10.362282 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-65bbb7a5-c126-4b2d-84e8-9a8cd9ed69d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:10.374791 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-65bbb7a5-c126-4b2d-84e8-9a8cd9ed69d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1322 microversion: 2.1 time: 0.787691 Oct 04 03:30:10.375373 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 39/77] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:09 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1322 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:10.397757 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-82cb9370-c7ae-426a-9400-a1ba600d4e6b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:10.398608 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-82cb9370-c7ae-426a-9400-a1ba600d4e6b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:10.425965 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82cb9370-c7ae-426a-9400-a1ba600d4e6b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:10.429086 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82cb9370-c7ae-426a-9400-a1ba600d4e6b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:10.434906 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82cb9370-c7ae-426a-9400-a1ba600d4e6b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:10.438195 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82cb9370-c7ae-426a-9400-a1ba600d4e6b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:10.439316 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82cb9370-c7ae-426a-9400-a1ba600d4e6b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:10.440525 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82cb9370-c7ae-426a-9400-a1ba600d4e6b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:10.622108 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-26c4e9fa-6a7a-491e-ac75-229cd7a9ca79 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:10.642126 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-26c4e9fa-6a7a-491e-ac75-229cd7a9ca79 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1362 microversion: 2.1 time: 0.805466 Oct 04 03:30:10.644247 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 39/78] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:09 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1362 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:10.669842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-3ad4ee59-5c10-4dfe-9204-76365146b452 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:10.676929 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-3ad4ee59-5c10-4dfe-9204-76365146b452 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:10.708243 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3ad4ee59-5c10-4dfe-9204-76365146b452 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:10.712019 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3ad4ee59-5c10-4dfe-9204-76365146b452 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:10.714939 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3ad4ee59-5c10-4dfe-9204-76365146b452 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:10.715752 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3ad4ee59-5c10-4dfe-9204-76365146b452 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:10.716384 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3ad4ee59-5c10-4dfe-9204-76365146b452 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:10.730179 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3ad4ee59-5c10-4dfe-9204-76365146b452 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:11.252041 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-3ad4ee59-5c10-4dfe-9204-76365146b452 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:11.265231 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-3ad4ee59-5c10-4dfe-9204-76365146b452 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1312 microversion: 2.1 time: 0.613983 Oct 04 03:30:11.266681 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 40/79] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:10 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1312 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:11.275625 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f75f105b-051f-40fe-a48f-58925205ad74 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:11.276627 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f75f105b-051f-40fe-a48f-58925205ad74 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:11.287581 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f75f105b-051f-40fe-a48f-58925205ad74 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:11.288220 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-82cb9370-c7ae-426a-9400-a1ba600d4e6b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:11.288379 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f75f105b-051f-40fe-a48f-58925205ad74 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:11.288708 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f75f105b-051f-40fe-a48f-58925205ad74 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:11.289397 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f75f105b-051f-40fe-a48f-58925205ad74 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:11.289981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f75f105b-051f-40fe-a48f-58925205ad74 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:11.290526 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f75f105b-051f-40fe-a48f-58925205ad74 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:11.303631 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-82cb9370-c7ae-426a-9400-a1ba600d4e6b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:11.305656 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-82cb9370-c7ae-426a-9400-a1ba600d4e6b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:11.308422 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-82cb9370-c7ae-426a-9400-a1ba600d4e6b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1405 microversion: 2.20 time: 0.929465 Oct 04 03:30:11.309416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 40/80] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:30:10 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1405 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:30:11.315988 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-65658786-c257-4c03-8436-366a4f375d34 req-cef595c9-f3e9-42c2-8d16-ea05726b5979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05277cf6-48c9-4eba-ae7a-4c7023431f1e", "tag": "cee800ae-bdb3-403b-8297-cfe1d229c9e0"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:11.328939 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-65658786-c257-4c03-8436-366a4f375d34 req-cef595c9-f3e9-42c2-8d16-ea05726b5979 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:11.330685 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-65658786-c257-4c03-8436-366a4f375d34 req-cef595c9-f3e9-42c2-8d16-ea05726b5979 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:11.331477 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-65658786-c257-4c03-8436-366a4f375d34 req-cef595c9-f3e9-42c2-8d16-ea05726b5979 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:11.351921 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:11.373055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-65658786-c257-4c03-8436-366a4f375d34 req-cef595c9-f3e9-42c2-8d16-ea05726b5979 service nova] Creating event network-changed:cee800ae-bdb3-403b-8297-cfe1d229c9e0 for instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e on hv-cinder-84914 Oct 04 03:30:11.387147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-65658786-c257-4c03-8436-366a4f375d34 req-cef595c9-f3e9-42c2-8d16-ea05726b5979 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075110 Oct 04 03:30:11.390744 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 41/81] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:11.403770 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6a2772e8-ccfa-4480-af77-a423684ddc4d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:11.404477 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6a2772e8-ccfa-4480-af77-a423684ddc4d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:11.410881 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a2772e8-ccfa-4480-af77-a423684ddc4d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:11.412049 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a2772e8-ccfa-4480-af77-a423684ddc4d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:11.412670 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a2772e8-ccfa-4480-af77-a423684ddc4d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:11.414078 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a2772e8-ccfa-4480-af77-a423684ddc4d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:11.414677 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a2772e8-ccfa-4480-af77-a423684ddc4d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:11.415244 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a2772e8-ccfa-4480-af77-a423684ddc4d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:11.704277 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f75f105b-051f-40fe-a48f-58925205ad74 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:11.715631 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f75f105b-051f-40fe-a48f-58925205ad74 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1315 microversion: 2.1 time: 0.446223 Oct 04 03:30:11.735949 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 41/82] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:11 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:11.741345 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0d6e77b8-68c4-42bf-aaad-0b059e1afc29 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:11.742375 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-0d6e77b8-68c4-42bf-aaad-0b059e1afc29 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:11.749980 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d6e77b8-68c4-42bf-aaad-0b059e1afc29 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:11.750729 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d6e77b8-68c4-42bf-aaad-0b059e1afc29 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:11.751305 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d6e77b8-68c4-42bf-aaad-0b059e1afc29 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:11.752604 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d6e77b8-68c4-42bf-aaad-0b059e1afc29 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:11.753366 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d6e77b8-68c4-42bf-aaad-0b059e1afc29 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:11.754066 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d6e77b8-68c4-42bf-aaad-0b059e1afc29 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:11.851266 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6a2772e8-ccfa-4480-af77-a423684ddc4d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:11.875059 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6a2772e8-ccfa-4480-af77-a423684ddc4d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1322 microversion: 2.1 time: 0.466908 Oct 04 03:30:11.876412 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 42/83] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:11 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:12.265872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0d6e77b8-68c4-42bf-aaad-0b059e1afc29 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:12.268413 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=95 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:12.278016 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0d6e77b8-68c4-42bf-aaad-0b059e1afc29 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1362 microversion: 2.1 time: 0.540576 Oct 04 03:30:12.279265 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 42/84] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:11 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1362 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:12.298461 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-faf10889-f45f-4cf7-8e8d-3849692c6f74 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:12.299162 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-faf10889-f45f-4cf7-8e8d-3849692c6f74 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:12.312375 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-faf10889-f45f-4cf7-8e8d-3849692c6f74 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:12.312889 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-faf10889-f45f-4cf7-8e8d-3849692c6f74 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:12.313291 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-faf10889-f45f-4cf7-8e8d-3849692c6f74 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:12.320574 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-faf10889-f45f-4cf7-8e8d-3849692c6f74 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:12.321188 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-faf10889-f45f-4cf7-8e8d-3849692c6f74 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:12.321716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-faf10889-f45f-4cf7-8e8d-3849692c6f74 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:12.344635 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6ec1acee-03c6-4589-b0c9-3d2ea041889e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:12.345316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6ec1acee-03c6-4589-b0c9-3d2ea041889e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:12.361379 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6ec1acee-03c6-4589-b0c9-3d2ea041889e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:12.361912 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6ec1acee-03c6-4589-b0c9-3d2ea041889e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:12.362344 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6ec1acee-03c6-4589-b0c9-3d2ea041889e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:12.366895 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6ec1acee-03c6-4589-b0c9-3d2ea041889e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:12.373027 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6ec1acee-03c6-4589-b0c9-3d2ea041889e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:12.373469 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6ec1acee-03c6-4589-b0c9-3d2ea041889e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:12.728817 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-faf10889-f45f-4cf7-8e8d-3849692c6f74 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:12.740433 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-faf10889-f45f-4cf7-8e8d-3849692c6f74 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1300 microversion: 2.1 time: 0.445535 Oct 04 03:30:12.741025 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 43/85] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:12 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1300 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:12.782087 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8e165b8a-5e67-4ff8-a490-6f07d8155708 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:12.782696 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8e165b8a-5e67-4ff8-a490-6f07d8155708 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:12.821672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e165b8a-5e67-4ff8-a490-6f07d8155708 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:12.828418 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e165b8a-5e67-4ff8-a490-6f07d8155708 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:12.829315 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e165b8a-5e67-4ff8-a490-6f07d8155708 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:12.830253 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e165b8a-5e67-4ff8-a490-6f07d8155708 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:12.830861 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e165b8a-5e67-4ff8-a490-6f07d8155708 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:12.831477 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e165b8a-5e67-4ff8-a490-6f07d8155708 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:13.211502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6ec1acee-03c6-4589-b0c9-3d2ea041889e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:13.227594 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6ec1acee-03c6-4589-b0c9-3d2ea041889e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:13.231602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6ec1acee-03c6-4589-b0c9-3d2ea041889e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:13.235020 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6ec1acee-03c6-4589-b0c9-3d2ea041889e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1405 microversion: 2.20 time: 0.892697 Oct 04 03:30:13.236804 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 43/86] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:30:12 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1405 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:30:13.257633 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d8cf9bb6-4b4e-4c78-a798-343fd414df1f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:13.258465 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d8cf9bb6-4b4e-4c78-a798-343fd414df1f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:13.266695 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d8cf9bb6-4b4e-4c78-a798-343fd414df1f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:13.271089 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d8cf9bb6-4b4e-4c78-a798-343fd414df1f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:13.271229 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-8e165b8a-5e67-4ff8-a490-6f07d8155708 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:13.271880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d8cf9bb6-4b4e-4c78-a798-343fd414df1f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:13.276190 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d8cf9bb6-4b4e-4c78-a798-343fd414df1f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:13.276819 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d8cf9bb6-4b4e-4c78-a798-343fd414df1f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:13.277770 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d8cf9bb6-4b4e-4c78-a798-343fd414df1f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:13.286266 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8e165b8a-5e67-4ff8-a490-6f07d8155708 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1315 microversion: 2.1 time: 0.508438 Oct 04 03:30:13.287324 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 44/87] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:12 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:13.311124 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1c4d118d-a494-4a1c-acd5-605cbabfad97 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:13.311889 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1c4d118d-a494-4a1c-acd5-605cbabfad97 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:13.319658 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1c4d118d-a494-4a1c-acd5-605cbabfad97 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:13.321708 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1c4d118d-a494-4a1c-acd5-605cbabfad97 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:13.322350 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1c4d118d-a494-4a1c-acd5-605cbabfad97 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:13.325581 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1c4d118d-a494-4a1c-acd5-605cbabfad97 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:13.326231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1c4d118d-a494-4a1c-acd5-605cbabfad97 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:13.326848 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1c4d118d-a494-4a1c-acd5-605cbabfad97 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:13.911229 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=34 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:14.064549 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d8cf9bb6-4b4e-4c78-a798-343fd414df1f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:14.077361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d8cf9bb6-4b4e-4c78-a798-343fd414df1f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1322 microversion: 2.1 time: 0.839341 Oct 04 03:30:14.087713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 44/88] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:13 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1322 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:14.104462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-89aa63fb-5dfc-4e4f-bc00-eb85791c110f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:14.105201 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-89aa63fb-5dfc-4e4f-bc00-eb85791c110f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:14.115475 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89aa63fb-5dfc-4e4f-bc00-eb85791c110f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:14.116000 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89aa63fb-5dfc-4e4f-bc00-eb85791c110f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:14.117068 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89aa63fb-5dfc-4e4f-bc00-eb85791c110f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:14.117791 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89aa63fb-5dfc-4e4f-bc00-eb85791c110f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:14.118252 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89aa63fb-5dfc-4e4f-bc00-eb85791c110f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:14.118866 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89aa63fb-5dfc-4e4f-bc00-eb85791c110f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:14.129592 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1c4d118d-a494-4a1c-acd5-605cbabfad97 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:14.137961 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1c4d118d-a494-4a1c-acd5-605cbabfad97 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1362 microversion: 2.1 time: 0.833377 Oct 04 03:30:14.155406 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 45/89] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:13 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1362 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:14.274825 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-9a85b6f7-6371-4ed6-b6de-c3045985ffd9 req-577f06a1-0cb7-43f7-a768-a66b5d8a895c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d49bbae-bf97-4c67-a54a-3625acee0ba0", "tag": "e0fdb780-8d0f-42bb-84b6-8c188eade731"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:14.288944 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9a85b6f7-6371-4ed6-b6de-c3045985ffd9 req-577f06a1-0cb7-43f7-a768-a66b5d8a895c service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:14.289689 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9a85b6f7-6371-4ed6-b6de-c3045985ffd9 req-577f06a1-0cb7-43f7-a768-a66b5d8a895c service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:14.290195 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9a85b6f7-6371-4ed6-b6de-c3045985ffd9 req-577f06a1-0cb7-43f7-a768-a66b5d8a895c service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:14.314546 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-9a85b6f7-6371-4ed6-b6de-c3045985ffd9 req-577f06a1-0cb7-43f7-a768-a66b5d8a895c service nova] Creating event network-changed:e0fdb780-8d0f-42bb-84b6-8c188eade731 for instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 on hv-cinder-84914 Oct 04 03:30:14.326755 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-9a85b6f7-6371-4ed6-b6de-c3045985ffd9 req-577f06a1-0cb7-43f7-a768-a66b5d8a895c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165837 Oct 04 03:30:14.328016 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 46/90] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:14.340398 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f4d374bb-9bf4-42f8-836c-0424c92f7a65 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:14.341117 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f4d374bb-9bf4-42f8-836c-0424c92f7a65 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:14.350938 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4d374bb-9bf4-42f8-836c-0424c92f7a65 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:14.351654 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4d374bb-9bf4-42f8-836c-0424c92f7a65 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:14.352110 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4d374bb-9bf4-42f8-836c-0424c92f7a65 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:14.355832 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4d374bb-9bf4-42f8-836c-0424c92f7a65 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:14.356817 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4d374bb-9bf4-42f8-836c-0424c92f7a65 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:14.357266 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4d374bb-9bf4-42f8-836c-0424c92f7a65 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:14.418611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-89aa63fb-5dfc-4e4f-bc00-eb85791c110f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:14.426851 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-89aa63fb-5dfc-4e4f-bc00-eb85791c110f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1368 microversion: 2.1 time: 0.330525 Oct 04 03:30:14.434602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 45/91] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:14 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1368 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:14.439694 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c4380ea8-9276-441e-a33a-9e1ec8050d80 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:14.443595 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c4380ea8-9276-441e-a33a-9e1ec8050d80 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:14.460034 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c4380ea8-9276-441e-a33a-9e1ec8050d80 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:14.460609 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c4380ea8-9276-441e-a33a-9e1ec8050d80 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:14.461053 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c4380ea8-9276-441e-a33a-9e1ec8050d80 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:14.461770 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c4380ea8-9276-441e-a33a-9e1ec8050d80 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:14.462211 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c4380ea8-9276-441e-a33a-9e1ec8050d80 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:14.462727 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c4380ea8-9276-441e-a33a-9e1ec8050d80 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:15.117292 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f4d374bb-9bf4-42f8-836c-0424c92f7a65 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:15.136704 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f4d374bb-9bf4-42f8-836c-0424c92f7a65 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:15.138771 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f4d374bb-9bf4-42f8-836c-0424c92f7a65 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:15.140874 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f4d374bb-9bf4-42f8-836c-0424c92f7a65 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1405 microversion: 2.20 time: 0.810625 Oct 04 03:30:15.141928 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 47/92] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:30:14 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1405 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:30:15.401960 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c4380ea8-9276-441e-a33a-9e1ec8050d80 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:15.419732 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c4380ea8-9276-441e-a33a-9e1ec8050d80 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1315 microversion: 2.1 time: 0.983697 Oct 04 03:30:15.424280 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 46/93] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:14 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1315 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:15.431329 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c64adfeb-2fd3-4a2a-ad57-5ea28c1afe80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:15.432419 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c64adfeb-2fd3-4a2a-ad57-5ea28c1afe80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:15.440498 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c64adfeb-2fd3-4a2a-ad57-5ea28c1afe80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:15.441308 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c64adfeb-2fd3-4a2a-ad57-5ea28c1afe80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:15.442025 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c64adfeb-2fd3-4a2a-ad57-5ea28c1afe80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:15.443575 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c64adfeb-2fd3-4a2a-ad57-5ea28c1afe80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:15.444278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c64adfeb-2fd3-4a2a-ad57-5ea28c1afe80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:15.445637 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c64adfeb-2fd3-4a2a-ad57-5ea28c1afe80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:15.561237 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-e99ade6c-2a3b-4646-a16d-f3aebb05675a req-604743a4-55b2-4b39-99c1-30e11fe7677a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb818d91-3d4e-47d8-8f9f-05296ee3f350", "name": "network-vif-plugged", "status": "completed", "tag": "d97fb947-abe0-495b-b10d-df45d3a61b91"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:15.578436 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-e99ade6c-2a3b-4646-a16d-f3aebb05675a req-604743a4-55b2-4b39-99c1-30e11fe7677a service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:15.579231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-e99ade6c-2a3b-4646-a16d-f3aebb05675a req-604743a4-55b2-4b39-99c1-30e11fe7677a service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:15.579886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-e99ade6c-2a3b-4646-a16d-f3aebb05675a req-604743a4-55b2-4b39-99c1-30e11fe7677a service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:15.592966 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-e99ade6c-2a3b-4646-a16d-f3aebb05675a req-604743a4-55b2-4b39-99c1-30e11fe7677a service nova] Creating event network-vif-plugged:d97fb947-abe0-495b-b10d-df45d3a61b91 for instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 on hv-cinder-84914 Oct 04 03:30:15.599078 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-e99ade6c-2a3b-4646-a16d-f3aebb05675a req-604743a4-55b2-4b39-99c1-30e11fe7677a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.455623 Oct 04 03:30:15.600287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 48/94] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:15.607120 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9d2de3ec-6c9b-4209-8967-8da8f49342db tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:15.608118 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9d2de3ec-6c9b-4209-8967-8da8f49342db tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:15.631087 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d2de3ec-6c9b-4209-8967-8da8f49342db tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:15.631894 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d2de3ec-6c9b-4209-8967-8da8f49342db tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:15.632532 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d2de3ec-6c9b-4209-8967-8da8f49342db tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:15.633430 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d2de3ec-6c9b-4209-8967-8da8f49342db tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:15.634250 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d2de3ec-6c9b-4209-8967-8da8f49342db tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:15.635138 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d2de3ec-6c9b-4209-8967-8da8f49342db tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:15.942388 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=10 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:16.043454 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c64adfeb-2fd3-4a2a-ad57-5ea28c1afe80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:16.056166 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c64adfeb-2fd3-4a2a-ad57-5ea28c1afe80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1322 microversion: 2.1 time: 0.630438 Oct 04 03:30:16.057278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 47/95] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:15 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1322 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:16.064326 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-d6713edd-7bf5-4a3f-9244-830816bd7c22 req-bc825997-fa51-4df5-bdbe-52141171c816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79803288-b24a-4fcd-9ed9-b08111250cc5", "tag": "1af39c75-2f24-46f5-9b6f-18624935b4cc"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:16.080250 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-d6713edd-7bf5-4a3f-9244-830816bd7c22 req-bc825997-fa51-4df5-bdbe-52141171c816 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:16.081074 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-d6713edd-7bf5-4a3f-9244-830816bd7c22 req-bc825997-fa51-4df5-bdbe-52141171c816 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:16.082421 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-d6713edd-7bf5-4a3f-9244-830816bd7c22 req-bc825997-fa51-4df5-bdbe-52141171c816 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:16.105007 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-d6713edd-7bf5-4a3f-9244-830816bd7c22 req-bc825997-fa51-4df5-bdbe-52141171c816 service nova] Creating event network-changed:1af39c75-2f24-46f5-9b6f-18624935b4cc for instance 79803288-b24a-4fcd-9ed9-b08111250cc5 on hv-cinder-84914 Oct 04 03:30:16.111259 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-d6713edd-7bf5-4a3f-9244-830816bd7c22 req-bc825997-fa51-4df5-bdbe-52141171c816 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052518 Oct 04 03:30:16.112044 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 48/96] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:16.117028 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9d2de3ec-6c9b-4209-8967-8da8f49342db tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:16.118684 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d0170c84-5289-4a04-9d74-0554ad70f309 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:16.119475 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d0170c84-5289-4a04-9d74-0554ad70f309 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:16.124930 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9d2de3ec-6c9b-4209-8967-8da8f49342db tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1362 microversion: 2.1 time: 0.523258 Oct 04 03:30:16.126347 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 49/97] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:15 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1362 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:16.132344 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d0170c84-5289-4a04-9d74-0554ad70f309 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:16.133088 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d0170c84-5289-4a04-9d74-0554ad70f309 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:16.134116 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d0170c84-5289-4a04-9d74-0554ad70f309 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:16.135085 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d0170c84-5289-4a04-9d74-0554ad70f309 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:16.135946 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d0170c84-5289-4a04-9d74-0554ad70f309 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:16.136710 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d0170c84-5289-4a04-9d74-0554ad70f309 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:16.167426 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c0ae2132-9d27-4939-86cd-6240a2af8643 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:16.168158 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c0ae2132-9d27-4939-86cd-6240a2af8643 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:16.178997 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0ae2132-9d27-4939-86cd-6240a2af8643 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:16.179537 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0ae2132-9d27-4939-86cd-6240a2af8643 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:16.180290 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0ae2132-9d27-4939-86cd-6240a2af8643 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:16.181945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0ae2132-9d27-4939-86cd-6240a2af8643 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:16.182822 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0ae2132-9d27-4939-86cd-6240a2af8643 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:16.183324 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0ae2132-9d27-4939-86cd-6240a2af8643 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:16.475804 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d0170c84-5289-4a04-9d74-0554ad70f309 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:16.487664 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d0170c84-5289-4a04-9d74-0554ad70f309 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1368 microversion: 2.1 time: 0.374111 Oct 04 03:30:16.489325 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 49/98] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:16 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1368 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:16.503072 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c0ae2132-9d27-4939-86cd-6240a2af8643 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:16.511228 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-70fd19ae-2e30-4cc9-8747-d6755187c5c6 req-e7a7a12f-3999-486e-a994-ca21ae261da8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a0a3732-a69d-4749-ad7e-c24ae04bbb44", "tag": "57c37564-5b7c-476f-9220-e715c56dbbb2"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:16.517499 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c0ae2132-9d27-4939-86cd-6240a2af8643 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:16.519373 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c0ae2132-9d27-4939-86cd-6240a2af8643 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:16.521147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c0ae2132-9d27-4939-86cd-6240a2af8643 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1405 microversion: 2.20 time: 0.357448 Oct 04 03:30:16.523191 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 50/99] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:30:16 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1405 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:30:16.529461 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0ace3a67-4c54-48e5-b5c9-a49a5f7557a9 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:16.530295 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0ace3a67-4c54-48e5-b5c9-a49a5f7557a9 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:16.537845 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0ace3a67-4c54-48e5-b5c9-a49a5f7557a9 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:16.538646 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0ace3a67-4c54-48e5-b5c9-a49a5f7557a9 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:16.539149 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0ace3a67-4c54-48e5-b5c9-a49a5f7557a9 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:16.540413 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0ace3a67-4c54-48e5-b5c9-a49a5f7557a9 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:16.541982 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0ace3a67-4c54-48e5-b5c9-a49a5f7557a9 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:16.542626 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0ace3a67-4c54-48e5-b5c9-a49a5f7557a9 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:16.557587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-70fd19ae-2e30-4cc9-8747-d6755187c5c6 req-e7a7a12f-3999-486e-a994-ca21ae261da8 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:16.558359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-70fd19ae-2e30-4cc9-8747-d6755187c5c6 req-e7a7a12f-3999-486e-a994-ca21ae261da8 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:16.558901 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-70fd19ae-2e30-4cc9-8747-d6755187c5c6 req-e7a7a12f-3999-486e-a994-ca21ae261da8 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:16.589866 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-70fd19ae-2e30-4cc9-8747-d6755187c5c6 req-e7a7a12f-3999-486e-a994-ca21ae261da8 service nova] Creating event network-changed:57c37564-5b7c-476f-9220-e715c56dbbb2 for instance 9a0a3732-a69d-4749-ad7e-c24ae04bbb44 on hv-cinder-84914 Oct 04 03:30:16.601524 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-70fd19ae-2e30-4cc9-8747-d6755187c5c6 req-e7a7a12f-3999-486e-a994-ca21ae261da8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110498 Oct 04 03:30:16.605630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 50/100] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:16.754082 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-0ace3a67-4c54-48e5-b5c9-a49a5f7557a9 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:16.771864 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0ace3a67-4c54-48e5-b5c9-a49a5f7557a9 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1315 microversion: 2.1 time: 0.247227 Oct 04 03:30:16.772788 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 51/101] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:16 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:17.092099 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2c0ff78c-cd8e-4f86-a79b-25a25cca6b16 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:17.093484 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-2c0ff78c-cd8e-4f86-a79b-25a25cca6b16 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:17.101293 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2c0ff78c-cd8e-4f86-a79b-25a25cca6b16 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:17.102069 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2c0ff78c-cd8e-4f86-a79b-25a25cca6b16 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:17.102734 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2c0ff78c-cd8e-4f86-a79b-25a25cca6b16 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:17.103766 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2c0ff78c-cd8e-4f86-a79b-25a25cca6b16 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:17.104711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2c0ff78c-cd8e-4f86-a79b-25a25cca6b16 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:17.105326 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2c0ff78c-cd8e-4f86-a79b-25a25cca6b16 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:17.154704 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-81629b04-2be7-48ec-b3e9-76ef4719643f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:17.157570 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-81629b04-2be7-48ec-b3e9-76ef4719643f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:17.181214 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-81629b04-2be7-48ec-b3e9-76ef4719643f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:17.182618 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-81629b04-2be7-48ec-b3e9-76ef4719643f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:17.183376 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-81629b04-2be7-48ec-b3e9-76ef4719643f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:17.186035 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-81629b04-2be7-48ec-b3e9-76ef4719643f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:17.186746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-81629b04-2be7-48ec-b3e9-76ef4719643f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:17.187442 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-81629b04-2be7-48ec-b3e9-76ef4719643f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:17.507080 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-2c0ff78c-cd8e-4f86-a79b-25a25cca6b16 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:17.515473 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2c0ff78c-cd8e-4f86-a79b-25a25cca6b16 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1322 microversion: 2.1 time: 0.436676 Oct 04 03:30:17.516240 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 51/102] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:17 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1322 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:17.528342 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c6668d7f-2119-4c67-8a08-1a8ab8316844 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:17.528851 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c6668d7f-2119-4c67-8a08-1a8ab8316844 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:17.541390 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c6668d7f-2119-4c67-8a08-1a8ab8316844 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:17.541877 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c6668d7f-2119-4c67-8a08-1a8ab8316844 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:17.542306 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c6668d7f-2119-4c67-8a08-1a8ab8316844 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:17.543011 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c6668d7f-2119-4c67-8a08-1a8ab8316844 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:17.543465 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c6668d7f-2119-4c67-8a08-1a8ab8316844 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:17.543948 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c6668d7f-2119-4c67-8a08-1a8ab8316844 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:17.554011 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-81629b04-2be7-48ec-b3e9-76ef4719643f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:17.562022 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-81629b04-2be7-48ec-b3e9-76ef4719643f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1362 microversion: 2.1 time: 0.413188 Oct 04 03:30:17.562804 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 52/103] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:17 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1362 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:17.568954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9f51749f-75dc-4988-8ee5-b06009d527e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:17.570093 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9f51749f-75dc-4988-8ee5-b06009d527e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:17.576270 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f51749f-75dc-4988-8ee5-b06009d527e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:17.577025 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f51749f-75dc-4988-8ee5-b06009d527e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:17.577828 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f51749f-75dc-4988-8ee5-b06009d527e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:17.578745 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f51749f-75dc-4988-8ee5-b06009d527e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:17.579584 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f51749f-75dc-4988-8ee5-b06009d527e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:17.580332 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f51749f-75dc-4988-8ee5-b06009d527e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:17.837027 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c6668d7f-2119-4c67-8a08-1a8ab8316844 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:17.855947 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c6668d7f-2119-4c67-8a08-1a8ab8316844 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1368 microversion: 2.1 time: 0.331092 Oct 04 03:30:17.856538 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 52/104] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:17 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1368 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:17.861206 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-679f6b17-bf5a-4fff-aa5e-e66465faac3b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:17.861993 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-679f6b17-bf5a-4fff-aa5e-e66465faac3b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:17.870337 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-679f6b17-bf5a-4fff-aa5e-e66465faac3b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:17.871014 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-679f6b17-bf5a-4fff-aa5e-e66465faac3b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:17.871635 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-679f6b17-bf5a-4fff-aa5e-e66465faac3b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:17.872487 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-679f6b17-bf5a-4fff-aa5e-e66465faac3b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:17.873505 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-679f6b17-bf5a-4fff-aa5e-e66465faac3b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:17.873671 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9f51749f-75dc-4988-8ee5-b06009d527e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:17.874219 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-679f6b17-bf5a-4fff-aa5e-e66465faac3b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:17.889452 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9f51749f-75dc-4988-8ee5-b06009d527e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:17.891944 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9f51749f-75dc-4988-8ee5-b06009d527e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:17.894511 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9f51749f-75dc-4988-8ee5-b06009d527e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1405 microversion: 2.20 time: 0.330628 Oct 04 03:30:17.896200 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 53/105] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:30:17 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1405 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:30:18.099462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-679f6b17-bf5a-4fff-aa5e-e66465faac3b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:18.109827 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-679f6b17-bf5a-4fff-aa5e-e66465faac3b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1315 microversion: 2.1 time: 0.252146 Oct 04 03:30:18.110731 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 53/106] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:17 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:18.540800 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0f9e28d1-d4aa-4cf2-827d-b5a59e2434b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:18.541555 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0f9e28d1-d4aa-4cf2-827d-b5a59e2434b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:18.548795 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f9e28d1-d4aa-4cf2-827d-b5a59e2434b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:18.549298 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f9e28d1-d4aa-4cf2-827d-b5a59e2434b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:18.549726 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f9e28d1-d4aa-4cf2-827d-b5a59e2434b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:18.551061 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f9e28d1-d4aa-4cf2-827d-b5a59e2434b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:18.553244 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f9e28d1-d4aa-4cf2-827d-b5a59e2434b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:18.553833 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f9e28d1-d4aa-4cf2-827d-b5a59e2434b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:18.589650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a61fef2e-c699-4de5-b69b-bed436a851d3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:18.590833 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a61fef2e-c699-4de5-b69b-bed436a851d3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:18.602429 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=28 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:18.605006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a61fef2e-c699-4de5-b69b-bed436a851d3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:18.607302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a61fef2e-c699-4de5-b69b-bed436a851d3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:18.607937 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a61fef2e-c699-4de5-b69b-bed436a851d3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:18.613030 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a61fef2e-c699-4de5-b69b-bed436a851d3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:18.613772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a61fef2e-c699-4de5-b69b-bed436a851d3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:18.615567 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a61fef2e-c699-4de5-b69b-bed436a851d3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:18.808307 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-0f9e28d1-d4aa-4cf2-827d-b5a59e2434b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:18.828458 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0f9e28d1-d4aa-4cf2-827d-b5a59e2434b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1322 microversion: 2.1 time: 0.294117 Oct 04 03:30:18.830375 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 54/107] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:18 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:18.884823 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-237663d4-ed22-4975-8b04-63ba9bbe0dc6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:18.885793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-237663d4-ed22-4975-8b04-63ba9bbe0dc6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:18.892023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:18.894085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-237663d4-ed22-4975-8b04-63ba9bbe0dc6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:18.895645 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-237663d4-ed22-4975-8b04-63ba9bbe0dc6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:18.896469 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-237663d4-ed22-4975-8b04-63ba9bbe0dc6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:18.897655 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-237663d4-ed22-4975-8b04-63ba9bbe0dc6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:18.898743 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-237663d4-ed22-4975-8b04-63ba9bbe0dc6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:18.899389 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-237663d4-ed22-4975-8b04-63ba9bbe0dc6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:18.934979 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a61fef2e-c699-4de5-b69b-bed436a851d3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:18.948812 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a61fef2e-c699-4de5-b69b-bed436a851d3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1362 microversion: 2.1 time: 0.363763 Oct 04 03:30:18.949460 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 54/108] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:18 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:30:18.970435 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-8ffcc32f-0373-43d6-905f-0a8e8e7cc913 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:18.979808 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-8ffcc32f-0373-43d6-905f-0a8e8e7cc913 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:18.992566 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8ffcc32f-0373-43d6-905f-0a8e8e7cc913 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:18.993060 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8ffcc32f-0373-43d6-905f-0a8e8e7cc913 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:18.993490 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8ffcc32f-0373-43d6-905f-0a8e8e7cc913 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:18.994188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8ffcc32f-0373-43d6-905f-0a8e8e7cc913 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:18.994637 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8ffcc32f-0373-43d6-905f-0a8e8e7cc913 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:18.995063 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8ffcc32f-0373-43d6-905f-0a8e8e7cc913 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:19.368461 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-237663d4-ed22-4975-8b04-63ba9bbe0dc6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:19.394317 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-237663d4-ed22-4975-8b04-63ba9bbe0dc6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1368 microversion: 2.1 time: 0.508542 Oct 04 03:30:19.395067 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 55/109] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:18 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1368 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:30:19.404850 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e2fce89b-bd50-4e6c-9179-58f35945cdca tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:19.405739 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e2fce89b-bd50-4e6c-9179-58f35945cdca tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:19.421026 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2fce89b-bd50-4e6c-9179-58f35945cdca tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:19.421895 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2fce89b-bd50-4e6c-9179-58f35945cdca tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:19.422473 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2fce89b-bd50-4e6c-9179-58f35945cdca tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:19.423746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2fce89b-bd50-4e6c-9179-58f35945cdca tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:19.424396 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2fce89b-bd50-4e6c-9179-58f35945cdca tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:19.426045 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2fce89b-bd50-4e6c-9179-58f35945cdca tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:19.610145 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-8ffcc32f-0373-43d6-905f-0a8e8e7cc913 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:19.628375 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-8ffcc32f-0373-43d6-905f-0a8e8e7cc913 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:19.630820 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-8ffcc32f-0373-43d6-905f-0a8e8e7cc913 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:19.632209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-8ffcc32f-0373-43d6-905f-0a8e8e7cc913 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1405 microversion: 2.20 time: 0.670197 Oct 04 03:30:19.640153 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 55/110] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:30:18 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1405 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:30:19.657479 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-23632621-3c49-42a1-bc9b-6362c2dc6fc9 req-548219c3-a438-46c5-b54c-49bb46f9e60d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f680f852-0ad9-4478-912f-1821b7755927", "name": "network-vif-plugged", "status": "completed", "tag": "b303180f-7432-4f63-b46d-6cc9c707c0d6"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:19.696988 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-23632621-3c49-42a1-bc9b-6362c2dc6fc9 req-548219c3-a438-46c5-b54c-49bb46f9e60d service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:19.697916 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-23632621-3c49-42a1-bc9b-6362c2dc6fc9 req-548219c3-a438-46c5-b54c-49bb46f9e60d service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:19.698748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-23632621-3c49-42a1-bc9b-6362c2dc6fc9 req-548219c3-a438-46c5-b54c-49bb46f9e60d service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:19.725153 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-23632621-3c49-42a1-bc9b-6362c2dc6fc9 req-548219c3-a438-46c5-b54c-49bb46f9e60d service nova] Creating event network-vif-plugged:b303180f-7432-4f63-b46d-6cc9c707c0d6 for instance f680f852-0ad9-4478-912f-1821b7755927 on hv-cinder-84914 Oct 04 03:30:19.736356 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-23632621-3c49-42a1-bc9b-6362c2dc6fc9 req-548219c3-a438-46c5-b54c-49bb46f9e60d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094791 Oct 04 03:30:19.737573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 56/111] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:19.816153 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e2fce89b-bd50-4e6c-9179-58f35945cdca tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:19.829249 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e2fce89b-bd50-4e6c-9179-58f35945cdca tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1502 microversion: 2.1 time: 0.432458 Oct 04 03:30:19.830026 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 56/112] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:19 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1502 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:19.854499 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-34e4fda6-a9c4-4b8f-93f3-91897ca6df11 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:19.863717 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-34e4fda6-a9c4-4b8f-93f3-91897ca6df11 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:19.880269 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-34e4fda6-a9c4-4b8f-93f3-91897ca6df11 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:19.884292 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-34e4fda6-a9c4-4b8f-93f3-91897ca6df11 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:19.886332 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-34e4fda6-a9c4-4b8f-93f3-91897ca6df11 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:19.890873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-34e4fda6-a9c4-4b8f-93f3-91897ca6df11 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:19.891378 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-34e4fda6-a9c4-4b8f-93f3-91897ca6df11 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:19.895667 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-34e4fda6-a9c4-4b8f-93f3-91897ca6df11 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:19.978939 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3d2f19ef-16b1-4afb-8cec-24cdfb663dc9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:19.979738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3d2f19ef-16b1-4afb-8cec-24cdfb663dc9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:19.993113 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3d2f19ef-16b1-4afb-8cec-24cdfb663dc9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:19.996390 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3d2f19ef-16b1-4afb-8cec-24cdfb663dc9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:19.997264 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3d2f19ef-16b1-4afb-8cec-24cdfb663dc9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:19.998026 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3d2f19ef-16b1-4afb-8cec-24cdfb663dc9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:19.998489 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3d2f19ef-16b1-4afb-8cec-24cdfb663dc9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:19.998927 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3d2f19ef-16b1-4afb-8cec-24cdfb663dc9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:20.784101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-3d2f19ef-16b1-4afb-8cec-24cdfb663dc9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:20.807318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3d2f19ef-16b1-4afb-8cec-24cdfb663dc9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1362 microversion: 2.1 time: 0.831340 Oct 04 03:30:20.811480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 57/113] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:19 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1362 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:30:20.826485 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-aff9414b-d77a-481c-a3ee-1c6ae12a1a25 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:20.828268 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-aff9414b-d77a-481c-a3ee-1c6ae12a1a25 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:20.844280 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aff9414b-d77a-481c-a3ee-1c6ae12a1a25 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:20.845468 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aff9414b-d77a-481c-a3ee-1c6ae12a1a25 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:20.845924 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aff9414b-d77a-481c-a3ee-1c6ae12a1a25 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:20.849072 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-34e4fda6-a9c4-4b8f-93f3-91897ca6df11 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:20.849718 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aff9414b-d77a-481c-a3ee-1c6ae12a1a25 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:20.849718 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aff9414b-d77a-481c-a3ee-1c6ae12a1a25 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:20.850249 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aff9414b-d77a-481c-a3ee-1c6ae12a1a25 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:20.859214 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-34e4fda6-a9c4-4b8f-93f3-91897ca6df11 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1322 microversion: 2.1 time: 1.009579 Oct 04 03:30:20.864373 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 57/114] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:19 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1322 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:20.871572 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-35c9140c-045d-458d-b1ae-4a3a0c263d96 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:20.872529 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-35c9140c-045d-458d-b1ae-4a3a0c263d96 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:20.897885 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-35c9140c-045d-458d-b1ae-4a3a0c263d96 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:20.898804 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-35c9140c-045d-458d-b1ae-4a3a0c263d96 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:20.900001 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-35c9140c-045d-458d-b1ae-4a3a0c263d96 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:20.902867 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-35c9140c-045d-458d-b1ae-4a3a0c263d96 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:20.903829 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-35c9140c-045d-458d-b1ae-4a3a0c263d96 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:20.905084 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-35c9140c-045d-458d-b1ae-4a3a0c263d96 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:21.273182 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-aff9414b-d77a-481c-a3ee-1c6ae12a1a25 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:21.287622 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-aff9414b-d77a-481c-a3ee-1c6ae12a1a25 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1368 microversion: 2.1 time: 0.471986 Oct 04 03:30:21.288240 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 58/115] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:20 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1368 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:21.293211 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-35c9140c-045d-458d-b1ae-4a3a0c263d96 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:21.313894 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-35c9140c-045d-458d-b1ae-4a3a0c263d96 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:21.316325 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-35c9140c-045d-458d-b1ae-4a3a0c263d96 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:21.320110 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-35c9140c-045d-458d-b1ae-4a3a0c263d96 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1405 microversion: 2.20 time: 0.453975 Oct 04 03:30:21.320986 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 58/116] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:30:20 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:30:21.665420 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e7595f03-5957-471f-a0a7-82d20b32abe7 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eb5662d-7491-422b-b4d4-7f6af27cff83"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:21.668013 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e7595f03-5957-471f-a0a7-82d20b32abe7 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:21.678186 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7595f03-5957-471f-a0a7-82d20b32abe7 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:21.678540 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7595f03-5957-471f-a0a7-82d20b32abe7 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:21.679290 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7595f03-5957-471f-a0a7-82d20b32abe7 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:21.680191 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7595f03-5957-471f-a0a7-82d20b32abe7 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:21.681002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7595f03-5957-471f-a0a7-82d20b32abe7 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:21.682385 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7595f03-5957-471f-a0a7-82d20b32abe7 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:21.766231 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-6ae81453-bd19-48a0-ac5f-8212045cdcc9 req-e946fdf6-9036-4748-afc3-dcb29ca36210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05277cf6-48c9-4eba-ae7a-4c7023431f1e", "name": "network-vif-plugged", "status": "completed", "tag": "cee800ae-bdb3-403b-8297-cfe1d229c9e0"}, {"server_uuid": "6d49bbae-bf97-4c67-a54a-3625acee0ba0", "name": "network-vif-plugged", "status": "completed", "tag": "e0fdb780-8d0f-42bb-84b6-8c188eade731"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:21.777967 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-6ae81453-bd19-48a0-ac5f-8212045cdcc9 req-e946fdf6-9036-4748-afc3-dcb29ca36210 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:21.778092 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-6ae81453-bd19-48a0-ac5f-8212045cdcc9 req-e946fdf6-9036-4748-afc3-dcb29ca36210 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:21.778463 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-6ae81453-bd19-48a0-ac5f-8212045cdcc9 req-e946fdf6-9036-4748-afc3-dcb29ca36210 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:21.793145 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-6ae81453-bd19-48a0-ac5f-8212045cdcc9 req-e946fdf6-9036-4748-afc3-dcb29ca36210 service nova] Creating event network-vif-plugged:cee800ae-bdb3-403b-8297-cfe1d229c9e0 for instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e on hv-cinder-84914 Oct 04 03:30:21.793653 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-6ae81453-bd19-48a0-ac5f-8212045cdcc9 req-e946fdf6-9036-4748-afc3-dcb29ca36210 service nova] Creating event network-vif-plugged:e0fdb780-8d0f-42bb-84b6-8c188eade731 for instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 on hv-cinder-84914 Oct 04 03:30:21.800631 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-6ae81453-bd19-48a0-ac5f-8212045cdcc9 req-e946fdf6-9036-4748-afc3-dcb29ca36210 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037961 Oct 04 03:30:21.804974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 59/117] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:21.843659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a906bbdf-ca18-4cba-a3c3-e442067d4849 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:21.846060 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a906bbdf-ca18-4cba-a3c3-e442067d4849 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:21.872345 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a906bbdf-ca18-4cba-a3c3-e442067d4849 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:21.875962 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a906bbdf-ca18-4cba-a3c3-e442067d4849 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:21.876140 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:21.876583 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a906bbdf-ca18-4cba-a3c3-e442067d4849 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:21.877725 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a906bbdf-ca18-4cba-a3c3-e442067d4849 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:21.878373 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a906bbdf-ca18-4cba-a3c3-e442067d4849 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:21.878837 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a906bbdf-ca18-4cba-a3c3-e442067d4849 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:22.137295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a906bbdf-ca18-4cba-a3c3-e442067d4849 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:22.144900 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a906bbdf-ca18-4cba-a3c3-e442067d4849 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1362 microversion: 2.1 time: 0.310737 Oct 04 03:30:22.145467 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 60/118] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:21 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:30:22.150134 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-754c4057-0038-4cbf-8224-b206163c85ac tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:22.150716 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-754c4057-0038-4cbf-8224-b206163c85ac tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:22.157003 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-754c4057-0038-4cbf-8224-b206163c85ac tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:22.157707 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-754c4057-0038-4cbf-8224-b206163c85ac tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:22.158213 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-754c4057-0038-4cbf-8224-b206163c85ac tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:22.159133 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-754c4057-0038-4cbf-8224-b206163c85ac tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:22.159719 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-754c4057-0038-4cbf-8224-b206163c85ac tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:22.160236 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-754c4057-0038-4cbf-8224-b206163c85ac tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:22.432080 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-754c4057-0038-4cbf-8224-b206163c85ac tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:22.445177 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-754c4057-0038-4cbf-8224-b206163c85ac tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1322 microversion: 2.1 time: 0.297937 Oct 04 03:30:22.447123 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 61/119] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:22 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:22.452278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-99df61f1-089c-49f9-a0f7-08d3284c8a29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:22.452957 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-99df61f1-089c-49f9-a0f7-08d3284c8a29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:22.460430 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-99df61f1-089c-49f9-a0f7-08d3284c8a29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:22.461390 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-99df61f1-089c-49f9-a0f7-08d3284c8a29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:22.462001 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-99df61f1-089c-49f9-a0f7-08d3284c8a29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:22.464750 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-99df61f1-089c-49f9-a0f7-08d3284c8a29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:22.465470 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-99df61f1-089c-49f9-a0f7-08d3284c8a29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:22.466043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-99df61f1-089c-49f9-a0f7-08d3284c8a29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:22.471360 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=100 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:22.673545 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-99df61f1-089c-49f9-a0f7-08d3284c8a29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:22.689550 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-99df61f1-089c-49f9-a0f7-08d3284c8a29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1368 microversion: 2.1 time: 0.239305 Oct 04 03:30:22.691286 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 62/120] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:22 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:22.700133 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0f76ba76-eb6b-4a61-9d55-9ac6414fb556 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:22.701916 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-0f76ba76-eb6b-4a61-9d55-9ac6414fb556 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:22.714110 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0f76ba76-eb6b-4a61-9d55-9ac6414fb556 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:22.715018 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0f76ba76-eb6b-4a61-9d55-9ac6414fb556 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:22.715872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0f76ba76-eb6b-4a61-9d55-9ac6414fb556 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:22.717779 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0f76ba76-eb6b-4a61-9d55-9ac6414fb556 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:22.718621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0f76ba76-eb6b-4a61-9d55-9ac6414fb556 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:22.719774 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0f76ba76-eb6b-4a61-9d55-9ac6414fb556 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:22.967901 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0f76ba76-eb6b-4a61-9d55-9ac6414fb556 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:22.978568 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0f76ba76-eb6b-4a61-9d55-9ac6414fb556 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:22.982976 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0f76ba76-eb6b-4a61-9d55-9ac6414fb556 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:22.985841 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0f76ba76-eb6b-4a61-9d55-9ac6414fb556 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1596 microversion: 2.20 time: 0.291919 Oct 04 03:30:22.988162 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 63/121] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:30:22 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1596 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:30:22.989238 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e7595f03-5957-471f-a0a7-82d20b32abe7 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "POST /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.326709 Oct 04 03:30:22.990732 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 59/122] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Oct 4 03:30:21 2022] POST /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350/os-volume_attachments => generated 194 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:23.017912 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-63445178-a575-4968-98ca-c4f3fd5739b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:23.019545 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-63445178-a575-4968-98ca-c4f3fd5739b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:23.028193 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63445178-a575-4968-98ca-c4f3fd5739b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:23.031539 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63445178-a575-4968-98ca-c4f3fd5739b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:23.032189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63445178-a575-4968-98ca-c4f3fd5739b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:23.033164 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63445178-a575-4968-98ca-c4f3fd5739b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:23.033894 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63445178-a575-4968-98ca-c4f3fd5739b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:23.034478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63445178-a575-4968-98ca-c4f3fd5739b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:23.168125 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9c81cd64-feb4-4b5e-9203-e966e8a27925 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:23.168929 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-9c81cd64-feb4-4b5e-9203-e966e8a27925 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:23.175423 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-63445178-a575-4968-98ca-c4f3fd5739b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.164515 Oct 04 03:30:23.176784 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 60/123] 10.222.0.25 () {60 vars in 1316 bytes} [Tue Oct 4 03:30:23 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:30:23.179972 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c81cd64-feb4-4b5e-9203-e966e8a27925 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:23.180711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c81cd64-feb4-4b5e-9203-e966e8a27925 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:23.181379 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c81cd64-feb4-4b5e-9203-e966e8a27925 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:23.182292 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c81cd64-feb4-4b5e-9203-e966e8a27925 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:23.182950 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c81cd64-feb4-4b5e-9203-e966e8a27925 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:23.183617 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c81cd64-feb4-4b5e-9203-e966e8a27925 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:23.420526 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-9c81cd64-feb4-4b5e-9203-e966e8a27925 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:23.433335 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-9c81cd64-feb4-4b5e-9203-e966e8a27925 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1362 microversion: 2.1 time: 0.268672 Oct 04 03:30:23.434814 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 64/124] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:23 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:23.479984 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-29478d9d-e91c-4840-a7c3-d57bae06c238 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:23.480619 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-29478d9d-e91c-4840-a7c3-d57bae06c238 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:23.491402 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-29478d9d-e91c-4840-a7c3-d57bae06c238 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:23.501614 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-29478d9d-e91c-4840-a7c3-d57bae06c238 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:23.503901 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-29478d9d-e91c-4840-a7c3-d57bae06c238 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:23.508070 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-29478d9d-e91c-4840-a7c3-d57bae06c238 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:23.510097 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-29478d9d-e91c-4840-a7c3-d57bae06c238 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:23.511017 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-29478d9d-e91c-4840-a7c3-d57bae06c238 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:23.721194 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-47665a57-193e-4239-a404-a50d22bf1b3c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:23.721659 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-29478d9d-e91c-4840-a7c3-d57bae06c238 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:23.723712 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-47665a57-193e-4239-a404-a50d22bf1b3c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:23.730889 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-29478d9d-e91c-4840-a7c3-d57bae06c238 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1322 microversion: 2.1 time: 0.263331 Oct 04 03:30:23.732325 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-47665a57-193e-4239-a404-a50d22bf1b3c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:23.733003 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-47665a57-193e-4239-a404-a50d22bf1b3c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:23.733876 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-47665a57-193e-4239-a404-a50d22bf1b3c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:23.733987 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 61/125] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:23 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:23.735170 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-47665a57-193e-4239-a404-a50d22bf1b3c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:23.735832 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-47665a57-193e-4239-a404-a50d22bf1b3c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:23.736541 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-47665a57-193e-4239-a404-a50d22bf1b3c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:23.827481 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-6056d029-280c-4b59-9542-2ef109d3ff72 req-264fb543-f006-4aaa-97fb-101d13d409a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0a3732-a69d-4749-ad7e-c24ae04bbb44", "name": "network-vif-plugged", "status": "completed", "tag": "57c37564-5b7c-476f-9220-e715c56dbbb2"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:23.843048 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-6056d029-280c-4b59-9542-2ef109d3ff72 req-264fb543-f006-4aaa-97fb-101d13d409a2 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:23.843547 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-6056d029-280c-4b59-9542-2ef109d3ff72 req-264fb543-f006-4aaa-97fb-101d13d409a2 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:23.843979 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-6056d029-280c-4b59-9542-2ef109d3ff72 req-264fb543-f006-4aaa-97fb-101d13d409a2 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:23.872407 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-6056d029-280c-4b59-9542-2ef109d3ff72 req-264fb543-f006-4aaa-97fb-101d13d409a2 service nova] Creating event network-vif-plugged:57c37564-5b7c-476f-9220-e715c56dbbb2 for instance 9a0a3732-a69d-4749-ad7e-c24ae04bbb44 on hv-cinder-84914 Oct 04 03:30:23.877879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-6056d029-280c-4b59-9542-2ef109d3ff72 req-264fb543-f006-4aaa-97fb-101d13d409a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054543 Oct 04 03:30:23.879878 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 62/126] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:30:23.967785 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-47665a57-193e-4239-a404-a50d22bf1b3c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:23.978542 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-47665a57-193e-4239-a404-a50d22bf1b3c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1368 microversion: 2.1 time: 0.264300 Oct 04 03:30:23.980061 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 65/127] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:23 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:24.469955 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-994cffee-4434-4252-8713-7aeacb4d1c1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:24.472720 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-994cffee-4434-4252-8713-7aeacb4d1c1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:24.490280 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-994cffee-4434-4252-8713-7aeacb4d1c1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:24.493707 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-994cffee-4434-4252-8713-7aeacb4d1c1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:24.494358 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-994cffee-4434-4252-8713-7aeacb4d1c1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:24.496721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-994cffee-4434-4252-8713-7aeacb4d1c1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:24.497312 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-994cffee-4434-4252-8713-7aeacb4d1c1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:24.497824 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-994cffee-4434-4252-8713-7aeacb4d1c1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:24.683909 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-994cffee-4434-4252-8713-7aeacb4d1c1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:24.693496 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-994cffee-4434-4252-8713-7aeacb4d1c1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1362 microversion: 2.1 time: 0.233450 Oct 04 03:30:24.707783 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 63/128] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:24 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:24.766446 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e1b65cf0-cc38-47e0-b033-aed3b7795ea2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:24.767663 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e1b65cf0-cc38-47e0-b033-aed3b7795ea2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:24.777699 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e1b65cf0-cc38-47e0-b033-aed3b7795ea2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:24.779988 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e1b65cf0-cc38-47e0-b033-aed3b7795ea2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:24.781434 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e1b65cf0-cc38-47e0-b033-aed3b7795ea2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:24.790094 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e1b65cf0-cc38-47e0-b033-aed3b7795ea2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:24.790847 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e1b65cf0-cc38-47e0-b033-aed3b7795ea2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:24.791425 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e1b65cf0-cc38-47e0-b033-aed3b7795ea2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:25.005887 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-59655046-da0e-4ed6-9f51-cf48d452f5d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:25.006636 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-59655046-da0e-4ed6-9f51-cf48d452f5d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:25.024380 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-59655046-da0e-4ed6-9f51-cf48d452f5d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:25.028230 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-59655046-da0e-4ed6-9f51-cf48d452f5d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:25.029155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-59655046-da0e-4ed6-9f51-cf48d452f5d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:25.032491 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-59655046-da0e-4ed6-9f51-cf48d452f5d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:25.034985 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-59655046-da0e-4ed6-9f51-cf48d452f5d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:25.036747 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-59655046-da0e-4ed6-9f51-cf48d452f5d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:25.131522 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e1b65cf0-cc38-47e0-b033-aed3b7795ea2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:25.144150 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e1b65cf0-cc38-47e0-b033-aed3b7795ea2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1322 microversion: 2.1 time: 0.379544 Oct 04 03:30:25.146854 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 66/129] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:24 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:25.331289 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-004201ed-1aa3-4537-aa3f-a3eee285e6af req-35a465b8-26ca-44d6-a59a-3e35466df168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f680f852-0ad9-4478-912f-1821b7755927", "tag": "b303180f-7432-4f63-b46d-6cc9c707c0d6"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:25.353714 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-004201ed-1aa3-4537-aa3f-a3eee285e6af req-35a465b8-26ca-44d6-a59a-3e35466df168 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:25.354799 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-004201ed-1aa3-4537-aa3f-a3eee285e6af req-35a465b8-26ca-44d6-a59a-3e35466df168 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:25.357536 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-004201ed-1aa3-4537-aa3f-a3eee285e6af req-35a465b8-26ca-44d6-a59a-3e35466df168 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:25.375720 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-004201ed-1aa3-4537-aa3f-a3eee285e6af req-35a465b8-26ca-44d6-a59a-3e35466df168 service nova] Creating event network-changed:b303180f-7432-4f63-b46d-6cc9c707c0d6 for instance f680f852-0ad9-4478-912f-1821b7755927 on hv-cinder-84914 Oct 04 03:30:25.392631 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-004201ed-1aa3-4537-aa3f-a3eee285e6af req-35a465b8-26ca-44d6-a59a-3e35466df168 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066822 Oct 04 03:30:25.397782 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 67/130] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:25.399758 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-59655046-da0e-4ed6-9f51-cf48d452f5d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:25.411399 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-59655046-da0e-4ed6-9f51-cf48d452f5d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1368 microversion: 2.1 time: 0.409025 Oct 04 03:30:25.412706 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 64/131] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:24 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1368 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:25.718931 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-4ee86556-64c3-440e-8203-f8599ee496f3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:25.719687 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-4ee86556-64c3-440e-8203-f8599ee496f3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:25.735476 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4ee86556-64c3-440e-8203-f8599ee496f3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:25.736205 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4ee86556-64c3-440e-8203-f8599ee496f3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:25.736797 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4ee86556-64c3-440e-8203-f8599ee496f3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:25.737985 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4ee86556-64c3-440e-8203-f8599ee496f3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:25.738465 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4ee86556-64c3-440e-8203-f8599ee496f3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:25.738897 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4ee86556-64c3-440e-8203-f8599ee496f3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:25.901323 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-ceb8043a-6940-4f40-aaf4-f532e3ea21fe req-eef1ce87-7d89-4762-9fa4-1bb5ee3178da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79803288-b24a-4fcd-9ed9-b08111250cc5", "name": "network-vif-plugged", "status": "completed", "tag": "1af39c75-2f24-46f5-9b6f-18624935b4cc"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:25.918298 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4ee86556-64c3-440e-8203-f8599ee496f3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:25.921035 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ceb8043a-6940-4f40-aaf4-f532e3ea21fe req-eef1ce87-7d89-4762-9fa4-1bb5ee3178da service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:25.921508 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ceb8043a-6940-4f40-aaf4-f532e3ea21fe req-eef1ce87-7d89-4762-9fa4-1bb5ee3178da service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:25.925335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ceb8043a-6940-4f40-aaf4-f532e3ea21fe req-eef1ce87-7d89-4762-9fa4-1bb5ee3178da service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:25.929236 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-4ee86556-64c3-440e-8203-f8599ee496f3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1548 microversion: 2.1 time: 0.214313 Oct 04 03:30:25.929932 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 68/132] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:25 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1548 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:25.954742 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-95b644e5-104c-4d21-aa14-1ede60ee75c5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:25.955581 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-95b644e5-104c-4d21-aa14-1ede60ee75c5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:25.955878 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-ceb8043a-6940-4f40-aaf4-f532e3ea21fe req-eef1ce87-7d89-4762-9fa4-1bb5ee3178da service nova] Creating event network-vif-plugged:1af39c75-2f24-46f5-9b6f-18624935b4cc for instance 79803288-b24a-4fcd-9ed9-b08111250cc5 on hv-cinder-84914 Oct 04 03:30:25.962323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-95b644e5-104c-4d21-aa14-1ede60ee75c5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:25.962814 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-95b644e5-104c-4d21-aa14-1ede60ee75c5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:25.963453 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-95b644e5-104c-4d21-aa14-1ede60ee75c5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:25.964399 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-95b644e5-104c-4d21-aa14-1ede60ee75c5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:25.965036 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-95b644e5-104c-4d21-aa14-1ede60ee75c5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:25.965641 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-95b644e5-104c-4d21-aa14-1ede60ee75c5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:25.966656 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-ceb8043a-6940-4f40-aaf4-f532e3ea21fe req-eef1ce87-7d89-4762-9fa4-1bb5ee3178da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069519 Oct 04 03:30:25.969508 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 65/133] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:30:26.163858 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-95b644e5-104c-4d21-aa14-1ede60ee75c5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.213203 Oct 04 03:30:26.165255 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 69/134] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Oct 4 03:30:25 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:30:26.171219 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-06e329e9-d810-4ca6-bf24-32ee3980a1d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:26.171944 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-06e329e9-d810-4ca6-bf24-32ee3980a1d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:26.184692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06e329e9-d810-4ca6-bf24-32ee3980a1d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:26.185191 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06e329e9-d810-4ca6-bf24-32ee3980a1d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:26.185625 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06e329e9-d810-4ca6-bf24-32ee3980a1d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:26.186332 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06e329e9-d810-4ca6-bf24-32ee3980a1d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:26.186781 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06e329e9-d810-4ca6-bf24-32ee3980a1d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:26.187202 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06e329e9-d810-4ca6-bf24-32ee3980a1d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:26.436448 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e63882f0-ec9d-4b31-b21c-912d0fa34375 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:26.437051 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e63882f0-ec9d-4b31-b21c-912d0fa34375 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:26.452999 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e63882f0-ec9d-4b31-b21c-912d0fa34375 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:26.455541 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e63882f0-ec9d-4b31-b21c-912d0fa34375 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:26.456025 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e63882f0-ec9d-4b31-b21c-912d0fa34375 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:26.456823 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e63882f0-ec9d-4b31-b21c-912d0fa34375 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:26.460346 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e63882f0-ec9d-4b31-b21c-912d0fa34375 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:26.460809 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e63882f0-ec9d-4b31-b21c-912d0fa34375 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:27.107872 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-06e329e9-d810-4ca6-bf24-32ee3980a1d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:27.125529 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-06e329e9-d810-4ca6-bf24-32ee3980a1d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1322 microversion: 2.1 time: 0.959065 Oct 04 03:30:27.138520 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 66/135] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:26 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1322 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:27.236829 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e63882f0-ec9d-4b31-b21c-912d0fa34375 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:27.245498 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e63882f0-ec9d-4b31-b21c-912d0fa34375 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1368 microversion: 2.1 time: 0.812844 Oct 04 03:30:27.246420 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 70/136] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:26 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1368 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:30:27.934697 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-54f51a93-25e4-44e6-a142-2301270ed29a tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:27.935277 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-54f51a93-25e4-44e6-a142-2301270ed29a tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:27.946050 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-54f51a93-25e4-44e6-a142-2301270ed29a tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:27.946881 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-54f51a93-25e4-44e6-a142-2301270ed29a tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:27.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-54f51a93-25e4-44e6-a142-2301270ed29a tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:27.948150 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-54f51a93-25e4-44e6-a142-2301270ed29a tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:27.948630 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-54f51a93-25e4-44e6-a142-2301270ed29a tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:27.949209 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-54f51a93-25e4-44e6-a142-2301270ed29a tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:27.994676 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-54f51a93-25e4-44e6-a142-2301270ed29a tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:30:28.153908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2bec4aff-693c-4ebe-8c4e-cd151a090038 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:28.154519 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-2bec4aff-693c-4ebe-8c4e-cd151a090038 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:28.167447 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2bec4aff-693c-4ebe-8c4e-cd151a090038 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:28.168075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2bec4aff-693c-4ebe-8c4e-cd151a090038 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:28.168518 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2bec4aff-693c-4ebe-8c4e-cd151a090038 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:28.169233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2bec4aff-693c-4ebe-8c4e-cd151a090038 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:28.169676 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2bec4aff-693c-4ebe-8c4e-cd151a090038 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:28.185778 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2bec4aff-693c-4ebe-8c4e-cd151a090038 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:28.261068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-54f51a93-25e4-44e6-a142-2301270ed29a tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 204 len: 0 microversion: 2.1 time: 0.330153 Oct 04 03:30:28.274329 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 67/137] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:30:27 2022] DELETE /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:30:28.314975 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cd6f7a68-dc68-42cd-b707-15ace1401969 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:28.328964 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cd6f7a68-dc68-42cd-b707-15ace1401969 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:28.364080 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd6f7a68-dc68-42cd-b707-15ace1401969 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:28.367297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd6f7a68-dc68-42cd-b707-15ace1401969 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:28.370919 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd6f7a68-dc68-42cd-b707-15ace1401969 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:28.377865 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd6f7a68-dc68-42cd-b707-15ace1401969 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:28.378399 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd6f7a68-dc68-42cd-b707-15ace1401969 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:28.378783 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd6f7a68-dc68-42cd-b707-15ace1401969 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:29.277731 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-2bec4aff-693c-4ebe-8c4e-cd151a090038 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:29.319013 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2bec4aff-693c-4ebe-8c4e-cd151a090038 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1322 microversion: 2.1 time: 1.162432 Oct 04 03:30:29.321443 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 71/138] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:28 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1322 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:29.331848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-829115cc-02f5-4ff2-93b6-c1f02389024c tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:29.336910 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-829115cc-02f5-4ff2-93b6-c1f02389024c tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:29.352643 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-829115cc-02f5-4ff2-93b6-c1f02389024c tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:29.357316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-829115cc-02f5-4ff2-93b6-c1f02389024c tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:29.358125 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-829115cc-02f5-4ff2-93b6-c1f02389024c tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:29.359362 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-829115cc-02f5-4ff2-93b6-c1f02389024c tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:29.360433 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-829115cc-02f5-4ff2-93b6-c1f02389024c tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:29.366291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-829115cc-02f5-4ff2-93b6-c1f02389024c tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:29.409115 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-cd6f7a68-dc68-42cd-b707-15ace1401969 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:29.418488 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cd6f7a68-dc68-42cd-b707-15ace1401969 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1368 microversion: 2.1 time: 1.139931 Oct 04 03:30:29.419070 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 68/139] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:28 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1368 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:29.541624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-46408d3e-e53f-4060-8152-996c9c9aca2f req-6169354e-9f07-4204-9479-3bf80580be53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d49bbae-bf97-4c67-a54a-3625acee0ba0", "tag": "e0fdb780-8d0f-42bb-84b6-8c188eade731"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:29.560378 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-46408d3e-e53f-4060-8152-996c9c9aca2f req-6169354e-9f07-4204-9479-3bf80580be53 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:29.561036 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-46408d3e-e53f-4060-8152-996c9c9aca2f req-6169354e-9f07-4204-9479-3bf80580be53 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:29.561624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-46408d3e-e53f-4060-8152-996c9c9aca2f req-6169354e-9f07-4204-9479-3bf80580be53 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:29.592271 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-46408d3e-e53f-4060-8152-996c9c9aca2f req-6169354e-9f07-4204-9479-3bf80580be53 service nova] Creating event network-changed:e0fdb780-8d0f-42bb-84b6-8c188eade731 for instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 on hv-cinder-84914 Oct 04 03:30:29.605830 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-46408d3e-e53f-4060-8152-996c9c9aca2f req-6169354e-9f07-4204-9479-3bf80580be53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066029 Oct 04 03:30:29.606721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 69/140] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:30:29.667301 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-829115cc-02f5-4ff2-93b6-c1f02389024c tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:29.693457 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-829115cc-02f5-4ff2-93b6-c1f02389024c tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1554 microversion: 2.1 time: 0.370275 Oct 04 03:30:29.694341 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 72/141] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:29 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1554 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:30.351435 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-012a26d6-6907-4368-9ef5-76a9f49e457a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:30.353134 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-012a26d6-6907-4368-9ef5-76a9f49e457a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:30.368287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-012a26d6-6907-4368-9ef5-76a9f49e457a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:30.370671 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-012a26d6-6907-4368-9ef5-76a9f49e457a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:30.371809 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-012a26d6-6907-4368-9ef5-76a9f49e457a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:30.372891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-012a26d6-6907-4368-9ef5-76a9f49e457a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:30.373493 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-012a26d6-6907-4368-9ef5-76a9f49e457a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:30.374066 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-012a26d6-6907-4368-9ef5-76a9f49e457a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:30.448135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a2b6456b-65de-48c1-9b6c-d63f883f839d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:30.449503 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a2b6456b-65de-48c1-9b6c-d63f883f839d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:30.460784 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a2b6456b-65de-48c1-9b6c-d63f883f839d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:30.461700 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a2b6456b-65de-48c1-9b6c-d63f883f839d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:30.465771 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a2b6456b-65de-48c1-9b6c-d63f883f839d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:30.466723 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a2b6456b-65de-48c1-9b6c-d63f883f839d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:30.467345 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a2b6456b-65de-48c1-9b6c-d63f883f839d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:30.467868 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a2b6456b-65de-48c1-9b6c-d63f883f839d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:30.782020 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a2b6456b-65de-48c1-9b6c-d63f883f839d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:30.818936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a2b6456b-65de-48c1-9b6c-d63f883f839d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1559 microversion: 2.1 time: 0.371324 Oct 04 03:30:30.820209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 73/142] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:30 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1559 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:30:30.828712 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2453c5bc-4ff3-4e25-aeb9-c43d80c3e5b8 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:30.829694 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-2453c5bc-4ff3-4e25-aeb9-c43d80c3e5b8 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:30.837908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2453c5bc-4ff3-4e25-aeb9-c43d80c3e5b8 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:30.838795 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2453c5bc-4ff3-4e25-aeb9-c43d80c3e5b8 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:30.839449 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2453c5bc-4ff3-4e25-aeb9-c43d80c3e5b8 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:30.844863 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-012a26d6-6907-4368-9ef5-76a9f49e457a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:30.850810 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2453c5bc-4ff3-4e25-aeb9-c43d80c3e5b8 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:30.853261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2453c5bc-4ff3-4e25-aeb9-c43d80c3e5b8 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:30.856516 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-012a26d6-6907-4368-9ef5-76a9f49e457a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1516 microversion: 2.1 time: 0.513639 Oct 04 03:30:30.857359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2453c5bc-4ff3-4e25-aeb9-c43d80c3e5b8 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:30.861719 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 70/143] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:30 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1516 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:30.873465 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fc3140df-8023-41d6-be88-277e0110a554 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:30.874178 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-fc3140df-8023-41d6-be88-277e0110a554 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:30.923733 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fc3140df-8023-41d6-be88-277e0110a554 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:30.924960 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fc3140df-8023-41d6-be88-277e0110a554 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:30.925647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fc3140df-8023-41d6-be88-277e0110a554 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:30.926879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fc3140df-8023-41d6-be88-277e0110a554 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:30.927801 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fc3140df-8023-41d6-be88-277e0110a554 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:30.930767 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fc3140df-8023-41d6-be88-277e0110a554 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:31.132735 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-fc3140df-8023-41d6-be88-277e0110a554 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.264823 Oct 04 03:30:31.133656 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 71/144] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Oct 4 03:30:30 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-interface => generated 285 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:31.153344 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-634ae8a1-34f9-47c7-999d-58a7661f9969 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:31.155568 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-634ae8a1-34f9-47c7-999d-58a7661f9969 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:31.183453 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-634ae8a1-34f9-47c7-999d-58a7661f9969 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:31.187163 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-634ae8a1-34f9-47c7-999d-58a7661f9969 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:31.187719 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-634ae8a1-34f9-47c7-999d-58a7661f9969 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:31.188465 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-634ae8a1-34f9-47c7-999d-58a7661f9969 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:31.188924 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-634ae8a1-34f9-47c7-999d-58a7661f9969 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:31.189339 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-634ae8a1-34f9-47c7-999d-58a7661f9969 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:31.277158 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-634ae8a1-34f9-47c7-999d-58a7661f9969 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lazy-loading 'flavor' on Instance uuid 9a0a3732-a69d-4749-ad7e-c24ae04bbb44 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:30:31.320530 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-2453c5bc-4ff3-4e25-aeb9-c43d80c3e5b8 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:31.341655 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2453c5bc-4ff3-4e25-aeb9-c43d80c3e5b8 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1554 microversion: 2.1 time: 0.518924 Oct 04 03:30:31.342653 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 74/145] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:30 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1554 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:31.579254 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-634ae8a1-34f9-47c7-999d-58a7661f9969 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "POST /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44/action" status: 200 len: 32 microversion: 2.1 time: 0.428038 Oct 04 03:30:31.582687 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 72/146] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Oct 4 03:30:31 2022] POST /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44/action => generated 32 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 03:30:31.592544 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-cc1039c0-99ed-43ad-9649-9ed3e6801c10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:31.593771 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-cc1039c0-99ed-43ad-9649-9ed3e6801c10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:31.607749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cc1039c0-99ed-43ad-9649-9ed3e6801c10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:31.609875 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cc1039c0-99ed-43ad-9649-9ed3e6801c10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:31.616136 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cc1039c0-99ed-43ad-9649-9ed3e6801c10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:31.625589 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cc1039c0-99ed-43ad-9649-9ed3e6801c10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:31.632800 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cc1039c0-99ed-43ad-9649-9ed3e6801c10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:31.633957 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cc1039c0-99ed-43ad-9649-9ed3e6801c10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:32.326256 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-cc1039c0-99ed-43ad-9649-9ed3e6801c10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:32.352024 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-cc1039c0-99ed-43ad-9649-9ed3e6801c10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.763191 Oct 04 03:30:32.352907 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 75/147] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:31 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:30:32.370210 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d1662244-c68e-44fa-8314-3803b1516ace tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:32.373925 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d1662244-c68e-44fa-8314-3803b1516ace tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:32.383138 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d1662244-c68e-44fa-8314-3803b1516ace tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:32.383513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d1662244-c68e-44fa-8314-3803b1516ace tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:32.384424 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d1662244-c68e-44fa-8314-3803b1516ace tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:32.385480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d1662244-c68e-44fa-8314-3803b1516ace tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:32.387014 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d1662244-c68e-44fa-8314-3803b1516ace tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:32.387829 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d1662244-c68e-44fa-8314-3803b1516ace tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:33.247903 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-d1662244-c68e-44fa-8314-3803b1516ace tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:33.272491 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d1662244-c68e-44fa-8314-3803b1516ace tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1554 microversion: 2.1 time: 0.907741 Oct 04 03:30:33.274291 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 73/148] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:32 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1554 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:33.281535 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-1e685416-8361-4786-a6de-89f436f77569 req-efa380b1-d6ff-4dc9-9f65-dd0d2fb9b5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb818d91-3d4e-47d8-8f9f-05296ee3f350", "name": "network-vif-deleted", "tag": "d97fb947-abe0-495b-b10d-df45d3a61b91"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:33.322107 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-1e685416-8361-4786-a6de-89f436f77569 req-efa380b1-d6ff-4dc9-9f65-dd0d2fb9b5cf service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:33.326210 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-1e685416-8361-4786-a6de-89f436f77569 req-efa380b1-d6ff-4dc9-9f65-dd0d2fb9b5cf service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:33.327869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-1e685416-8361-4786-a6de-89f436f77569 req-efa380b1-d6ff-4dc9-9f65-dd0d2fb9b5cf service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:33.382372 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-86c97f8c-1253-45e1-b636-879a06b3b3cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:33.383756 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-86c97f8c-1253-45e1-b636-879a06b3b3cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:33.415385 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-86c97f8c-1253-45e1-b636-879a06b3b3cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:33.416041 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-86c97f8c-1253-45e1-b636-879a06b3b3cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:33.416474 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-86c97f8c-1253-45e1-b636-879a06b3b3cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:33.418997 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-1e685416-8361-4786-a6de-89f436f77569 req-efa380b1-d6ff-4dc9-9f65-dd0d2fb9b5cf service nova] Creating event network-vif-deleted:d97fb947-abe0-495b-b10d-df45d3a61b91 for instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 on hv-cinder-84914 Oct 04 03:30:33.421321 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-86c97f8c-1253-45e1-b636-879a06b3b3cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:33.425782 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-86c97f8c-1253-45e1-b636-879a06b3b3cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:33.429973 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-86c97f8c-1253-45e1-b636-879a06b3b3cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:33.440834 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-1e685416-8361-4786-a6de-89f436f77569 req-efa380b1-d6ff-4dc9-9f65-dd0d2fb9b5cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170065 Oct 04 03:30:33.448939 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 76/149] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:33.494690 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:34.304954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d50ac269-db6c-48c0-93eb-c7f175cc5d0b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:34.307331 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d50ac269-db6c-48c0-93eb-c7f175cc5d0b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:34.315339 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d50ac269-db6c-48c0-93eb-c7f175cc5d0b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:34.316237 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d50ac269-db6c-48c0-93eb-c7f175cc5d0b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:34.317408 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d50ac269-db6c-48c0-93eb-c7f175cc5d0b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:34.319082 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d50ac269-db6c-48c0-93eb-c7f175cc5d0b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:34.319878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d50ac269-db6c-48c0-93eb-c7f175cc5d0b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:34.320502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d50ac269-db6c-48c0-93eb-c7f175cc5d0b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:34.332066 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-86c97f8c-1253-45e1-b636-879a06b3b3cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:34.344025 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-86c97f8c-1253-45e1-b636-879a06b3b3cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.968478 Oct 04 03:30:34.356246 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 74/150] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:33 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:34.371256 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d50ac269-db6c-48c0-93eb-c7f175cc5d0b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:34.371773 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d50ac269-db6c-48c0-93eb-c7f175cc5d0b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:34.372212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d50ac269-db6c-48c0-93eb-c7f175cc5d0b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:34.372823 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-d50ac269-db6c-48c0-93eb-c7f175cc5d0b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lazy-loading 'fault' on Instance uuid bb818d91-3d4e-47d8-8f9f-05296ee3f350 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:30:34.498187 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d50ac269-db6c-48c0-93eb-c7f175cc5d0b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1b3303d5ca4f5e90176c05f35e70cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf5d7d94d442c28466101666bdcab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:34.510418 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d50ac269-db6c-48c0-93eb-c7f175cc5d0b tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 200 len: 1351 microversion: 2.1 time: 0.214906 Oct 04 03:30:34.510999 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 77/151] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:34 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 1351 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:34.894467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-4498e31f-4ae7-4e1d-acfb-3b17a7ad49cd req-9d850774-ac5f-4e77-a5e0-4c6ee5f03d57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79803288-b24a-4fcd-9ed9-b08111250cc5", "tag": "1af39c75-2f24-46f5-9b6f-18624935b4cc"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:34.935505 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:34.965058 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-4498e31f-4ae7-4e1d-acfb-3b17a7ad49cd req-9d850774-ac5f-4e77-a5e0-4c6ee5f03d57 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:34.966390 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-4498e31f-4ae7-4e1d-acfb-3b17a7ad49cd req-9d850774-ac5f-4e77-a5e0-4c6ee5f03d57 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:34.966972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-4498e31f-4ae7-4e1d-acfb-3b17a7ad49cd req-9d850774-ac5f-4e77-a5e0-4c6ee5f03d57 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:35.007158 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-4498e31f-4ae7-4e1d-acfb-3b17a7ad49cd req-9d850774-ac5f-4e77-a5e0-4c6ee5f03d57 service nova] Creating event network-changed:1af39c75-2f24-46f5-9b6f-18624935b4cc for instance 79803288-b24a-4fcd-9ed9-b08111250cc5 on hv-cinder-84914 Oct 04 03:30:35.015407 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-4498e31f-4ae7-4e1d-acfb-3b17a7ad49cd req-9d850774-ac5f-4e77-a5e0-4c6ee5f03d57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134023 Oct 04 03:30:35.016503 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 75/152] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:35.377702 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2d18d7d7-ea9f-4b2d-8602-884a4b5fbdd7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:35.378243 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-2d18d7d7-ea9f-4b2d-8602-884a4b5fbdd7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:35.387679 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d18d7d7-ea9f-4b2d-8602-884a4b5fbdd7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:35.388159 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d18d7d7-ea9f-4b2d-8602-884a4b5fbdd7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:35.389731 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d18d7d7-ea9f-4b2d-8602-884a4b5fbdd7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:35.390452 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d18d7d7-ea9f-4b2d-8602-884a4b5fbdd7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:35.390914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d18d7d7-ea9f-4b2d-8602-884a4b5fbdd7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:35.391428 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d18d7d7-ea9f-4b2d-8602-884a4b5fbdd7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:35.536808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-83e65424-4ef8-47eb-b4e5-f23ec5b4d172 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:35.537648 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-83e65424-4ef8-47eb-b4e5-f23ec5b4d172 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:35.553136 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e65424-4ef8-47eb-b4e5-f23ec5b4d172 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:35.562164 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e65424-4ef8-47eb-b4e5-f23ec5b4d172 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:35.566080 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e65424-4ef8-47eb-b4e5-f23ec5b4d172 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:35.567656 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e65424-4ef8-47eb-b4e5-f23ec5b4d172 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:35.569639 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e65424-4ef8-47eb-b4e5-f23ec5b4d172 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:35.570385 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e65424-4ef8-47eb-b4e5-f23ec5b4d172 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:35.596374 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-83e65424-4ef8-47eb-b4e5-f23ec5b4d172 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] HTTP exception thrown: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-83e65424-4ef8-47eb-b4e5-f23ec5b4d172 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Request method failure captured: Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 HTTP/1.1 Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6il3r2gCBNLTfZan81lpeyFrTFm528LVgBgK8qyC4ktX21N9GJw-Xw-SdC1Rs7wqI8JK4MtJlZc0pKfPpRTRTkboiw7pFTfDqJS15_MyKtgtIke2zCNpgR7TvtLjsd1qIab8iP8dntMqDmNTIXb38hzCrahNk0MBR41QltYS5Hnzhc Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: caaf5d7d94d442c28466101666bdcab0 Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-DeleteServersTestJSON-1762601530 Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:30:35.607359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:30:35.608793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/caaf5d7d94d442c28466101666bdcab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/caaf5d7d94d442c28466101666bdcab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_caaf5d7d94d442c28466101666bdcab0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/caaf5d7d94d442c28466101666bdcab0"}]}] Oct 04 03:30:35.608793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-DeleteServersTestJSON-1762601530 Oct 04 03:30:35.608793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: caaf5d7d94d442c28466101666bdcab0 Oct 04 03:30:35.608793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1762601530 Oct 04 03:30:35.608793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-DeleteServersTestJSON-1762601530-project Oct 04 03:30:35.608793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:30:35.608793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:30:35.608793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: 3e1b3303d5ca4f5e90176c05f35e70cd Oct 04 03:30:35.608793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-DeleteServersTestJSON-1762601530-project Oct 04 03:30:35.608793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:30:35.608793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:35.608793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': 'bb818d91-3d4e-47d8-8f9f-05296ee3f350'} Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:30:35.609513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:35.610746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:35.614154 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-83e65424-4ef8-47eb-b4e5-f23ec5b4d172 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Returning 404 to user: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:30:35.614154 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-83e65424-4ef8-47eb-b4e5-f23ec5b4d172 tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 404 len: 111 microversion: 2.1 time: 0.080229 Oct 04 03:30:35.614439 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 76/153] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:35 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 03:30:35.850133 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7a11d620-ba90-4408-b4e5-7d92dd9d732f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:35.852630 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7a11d620-ba90-4408-b4e5-7d92dd9d732f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:35.863088 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7a11d620-ba90-4408-b4e5-7d92dd9d732f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:35.868069 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7a11d620-ba90-4408-b4e5-7d92dd9d732f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:35.868640 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7a11d620-ba90-4408-b4e5-7d92dd9d732f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:35.869619 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7a11d620-ba90-4408-b4e5-7d92dd9d732f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:35.870185 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7a11d620-ba90-4408-b4e5-7d92dd9d732f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:35.870721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7a11d620-ba90-4408-b4e5-7d92dd9d732f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:35.925762 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-7a11d620-ba90-4408-b4e5-7d92dd9d732f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] HTTP exception thrown: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7a11d620-ba90-4408-b4e5-7d92dd9d732f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Request method failure captured: Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350/os-volume_attachments HTTP/1.1 Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6il3r2gCBNLTfZan81lpeyFrTFm528LVgBgK8qyC4ktX21N9GJw-Xw-SdC1Rs7wqI8JK4MtJlZc0pKfPpRTRTkboiw7pFTfDqJS15_MyKtgtIke2zCNpgR7TvtLjsd1qIab8iP8dntMqDmNTIXb38hzCrahNk0MBR41QltYS5Hnzhc Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: caaf5d7d94d442c28466101666bdcab0 Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-DeleteServersTestJSON-1762601530 Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:30:35.944305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:30:35.945561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/caaf5d7d94d442c28466101666bdcab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/caaf5d7d94d442c28466101666bdcab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_caaf5d7d94d442c28466101666bdcab0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/caaf5d7d94d442c28466101666bdcab0"}]}] Oct 04 03:30:35.945561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-DeleteServersTestJSON-1762601530 Oct 04 03:30:35.945561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: caaf5d7d94d442c28466101666bdcab0 Oct 04 03:30:35.945561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1762601530 Oct 04 03:30:35.945561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-DeleteServersTestJSON-1762601530-project Oct 04 03:30:35.945561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:30:35.945561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:30:35.945561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: 3e1b3303d5ca4f5e90176c05f35e70cd Oct 04 03:30:35.945561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-DeleteServersTestJSON-1762601530-project Oct 04 03:30:35.945561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:30:35.945561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:35.945561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'server_id': 'bb818d91-3d4e-47d8-8f9f-05296ee3f350'} Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:30:35.946198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:35.947318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:35.949626 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7a11d620-ba90-4408-b4e5-7d92dd9d732f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Returning 404 to user: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:30:35.950679 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7a11d620-ba90-4408-b4e5-7d92dd9d732f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.106069 Oct 04 03:30:35.951434 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 77/154] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:30:35 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350/os-volume_attachments => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:30:36.483827 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-2d18d7d7-ea9f-4b2d-8602-884a4b5fbdd7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:36.499144 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2d18d7d7-ea9f-4b2d-8602-884a4b5fbdd7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 1.132081 Oct 04 03:30:36.506663 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 78/155] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:35 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:37.414487 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-78aa890f-e742-44d2-a8d3-c94f4f3c7bfb tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:37.415844 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-78aa890f-e742-44d2-a8d3-c94f4f3c7bfb tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:37.426766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78aa890f-e742-44d2-a8d3-c94f4f3c7bfb tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:37.427439 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78aa890f-e742-44d2-a8d3-c94f4f3c7bfb tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:37.429029 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78aa890f-e742-44d2-a8d3-c94f4f3c7bfb tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:37.429952 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78aa890f-e742-44d2-a8d3-c94f4f3c7bfb tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:37.430417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78aa890f-e742-44d2-a8d3-c94f4f3c7bfb tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:37.431017 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78aa890f-e742-44d2-a8d3-c94f4f3c7bfb tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:37.450705 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-78aa890f-e742-44d2-a8d3-c94f4f3c7bfb tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] HTTP exception thrown: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-78aa890f-e742-44d2-a8d3-c94f4f3c7bfb tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Request method failure captured: Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: DELETE /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 HTTP/1.1 Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6il3r2gCBNLTfZan81lpeyFrTFm528LVgBgK8qyC4ktX21N9GJw-Xw-SdC1Rs7wqI8JK4MtJlZc0pKfPpRTRTkboiw7pFTfDqJS15_MyKtgtIke2zCNpgR7TvtLjsd1qIab8iP8dntMqDmNTIXb38hzCrahNk0MBR41QltYS5Hnzhc Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: caaf5d7d94d442c28466101666bdcab0 Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-DeleteServersTestJSON-1762601530 Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:30:37.453142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:30:37.454664 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/caaf5d7d94d442c28466101666bdcab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/caaf5d7d94d442c28466101666bdcab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_caaf5d7d94d442c28466101666bdcab0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/caaf5d7d94d442c28466101666bdcab0"}]}] Oct 04 03:30:37.454664 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-DeleteServersTestJSON-1762601530 Oct 04 03:30:37.454664 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: caaf5d7d94d442c28466101666bdcab0 Oct 04 03:30:37.454664 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1762601530 Oct 04 03:30:37.454664 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-DeleteServersTestJSON-1762601530-project Oct 04 03:30:37.454664 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:30:37.454664 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:30:37.454664 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: 3e1b3303d5ca4f5e90176c05f35e70cd Oct 04 03:30:37.454664 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-DeleteServersTestJSON-1762601530-project Oct 04 03:30:37.454664 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:30:37.454664 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:37.454664 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': 'bb818d91-3d4e-47d8-8f9f-05296ee3f350'} Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:30:37.455504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:37.456837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:30:37.458884 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-78aa890f-e742-44d2-a8d3-c94f4f3c7bfb tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Returning 404 to user: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:30:37.461107 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-78aa890f-e742-44d2-a8d3-c94f4f3c7bfb tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 404 len: 111 microversion: 2.1 time: 0.050880 Oct 04 03:30:37.463030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 78/156] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:30:37 2022] DELETE /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:30:37.473184 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c018c778-5531-418a-af3e-7ccb213ff51f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:37.473989 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c018c778-5531-418a-af3e-7ccb213ff51f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] [instance: bb818d91-3d4e-47d8-8f9f-05296ee3f350] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:37.485805 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c018c778-5531-418a-af3e-7ccb213ff51f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:37.487385 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c018c778-5531-418a-af3e-7ccb213ff51f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:37.490685 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c018c778-5531-418a-af3e-7ccb213ff51f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:37.491746 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c018c778-5531-418a-af3e-7ccb213ff51f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:37.492665 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c018c778-5531-418a-af3e-7ccb213ff51f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:37.493163 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c018c778-5531-418a-af3e-7ccb213ff51f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:37.510038 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-c018c778-5531-418a-af3e-7ccb213ff51f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] HTTP exception thrown: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c018c778-5531-418a-af3e-7ccb213ff51f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Request method failure captured: Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 HTTP/1.1 Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6il3r2gCBNLTfZan81lpeyFrTFm528LVgBgK8qyC4ktX21N9GJw-Xw-SdC1Rs7wqI8JK4MtJlZc0pKfPpRTRTkboiw7pFTfDqJS15_MyKtgtIke2zCNpgR7TvtLjsd1qIab8iP8dntMqDmNTIXb38hzCrahNk0MBR41QltYS5Hnzhc Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: caaf5d7d94d442c28466101666bdcab0 Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-DeleteServersTestJSON-1762601530 Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:30:37.515908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:30:37.517102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/caaf5d7d94d442c28466101666bdcab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/caaf5d7d94d442c28466101666bdcab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_caaf5d7d94d442c28466101666bdcab0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/caaf5d7d94d442c28466101666bdcab0"}]}] Oct 04 03:30:37.517102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-DeleteServersTestJSON-1762601530 Oct 04 03:30:37.517102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: caaf5d7d94d442c28466101666bdcab0 Oct 04 03:30:37.517102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1762601530 Oct 04 03:30:37.517102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-DeleteServersTestJSON-1762601530-project Oct 04 03:30:37.517102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:30:37.517102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:30:37.517102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 3e1b3303d5ca4f5e90176c05f35e70cd Oct 04 03:30:37.517102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-DeleteServersTestJSON-1762601530-project Oct 04 03:30:37.517102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:30:37.517102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:37.517102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': 'bb818d91-3d4e-47d8-8f9f-05296ee3f350'} Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:30:37.517836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. Oct 04 03:30:37.518917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:30:37.521836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c018c778-5531-418a-af3e-7ccb213ff51f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] Returning 404 to user: Instance bb818d91-3d4e-47d8-8f9f-05296ee3f350 could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:30:37.523352 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c018c778-5531-418a-af3e-7ccb213ff51f tempest-DeleteServersTestJSON-1762601530 tempest-DeleteServersTestJSON-1762601530-project] 10.222.0.25 "GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350" status: 404 len: 111 microversion: 2.1 time: 0.056490 Oct 04 03:30:37.524455 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 79/157] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:37 2022] GET /compute/v2.1/servers/bb818d91-3d4e-47d8-8f9f-05296ee3f350 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:30:37.542583 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bd7c1d3c-5c3a-4f24-8083-942031191a44 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:37.543188 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bd7c1d3c-5c3a-4f24-8083-942031191a44 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:37.559309 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd7c1d3c-5c3a-4f24-8083-942031191a44 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:37.562587 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd7c1d3c-5c3a-4f24-8083-942031191a44 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:37.564175 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd7c1d3c-5c3a-4f24-8083-942031191a44 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:37.565074 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd7c1d3c-5c3a-4f24-8083-942031191a44 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:37.565684 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd7c1d3c-5c3a-4f24-8083-942031191a44 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:37.566322 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd7c1d3c-5c3a-4f24-8083-942031191a44 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:37.927439 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-bd7c1d3c-5c3a-4f24-8083-942031191a44 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:37.949403 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bd7c1d3c-5c3a-4f24-8083-942031191a44 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.416979 Oct 04 03:30:37.970202 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 79/158] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:37 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:38.978068 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e403daea-d441-48ee-8b7a-55341a230b38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:38.978850 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e403daea-d441-48ee-8b7a-55341a230b38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:38.991023 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e403daea-d441-48ee-8b7a-55341a230b38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:38.995393 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e403daea-d441-48ee-8b7a-55341a230b38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:38.996860 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e403daea-d441-48ee-8b7a-55341a230b38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:38.998846 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e403daea-d441-48ee-8b7a-55341a230b38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:38.999939 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e403daea-d441-48ee-8b7a-55341a230b38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:39.002582 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e403daea-d441-48ee-8b7a-55341a230b38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:39.354801 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e403daea-d441-48ee-8b7a-55341a230b38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:39.367763 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=100 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:39.392473 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e403daea-d441-48ee-8b7a-55341a230b38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.419543 Oct 04 03:30:39.398482 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 80/159] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:38 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:40.424596 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c148355f-c08d-4cf3-a851-3ab6285188b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:40.425240 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c148355f-c08d-4cf3-a851-3ab6285188b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:40.433043 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c148355f-c08d-4cf3-a851-3ab6285188b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:40.433526 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c148355f-c08d-4cf3-a851-3ab6285188b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:40.434247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c148355f-c08d-4cf3-a851-3ab6285188b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:40.435139 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c148355f-c08d-4cf3-a851-3ab6285188b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:40.435771 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c148355f-c08d-4cf3-a851-3ab6285188b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:40.436347 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c148355f-c08d-4cf3-a851-3ab6285188b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:40.639161 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c148355f-c08d-4cf3-a851-3ab6285188b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:40.671469 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c148355f-c08d-4cf3-a851-3ab6285188b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.241991 Oct 04 03:30:40.671469 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 80/160] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:40 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:41.689615 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a45ee0ea-965b-4b8c-8c54-12afc45e85a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:41.690726 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a45ee0ea-965b-4b8c-8c54-12afc45e85a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:41.703081 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=85 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:41.712863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a45ee0ea-965b-4b8c-8c54-12afc45e85a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:41.713631 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a45ee0ea-965b-4b8c-8c54-12afc45e85a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:41.714371 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a45ee0ea-965b-4b8c-8c54-12afc45e85a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:41.715285 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a45ee0ea-965b-4b8c-8c54-12afc45e85a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:41.716537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a45ee0ea-965b-4b8c-8c54-12afc45e85a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:41.717227 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a45ee0ea-965b-4b8c-8c54-12afc45e85a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:41.989390 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a45ee0ea-965b-4b8c-8c54-12afc45e85a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:42.020339 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a45ee0ea-965b-4b8c-8c54-12afc45e85a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.340447 Oct 04 03:30:42.020962 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 81/161] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:41 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:43.044574 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e759c2b4-7ba0-4d60-b142-8e4c3b0e6c70 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:43.045301 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e759c2b4-7ba0-4d60-b142-8e4c3b0e6c70 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:43.053362 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e759c2b4-7ba0-4d60-b142-8e4c3b0e6c70 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:43.054116 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e759c2b4-7ba0-4d60-b142-8e4c3b0e6c70 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:43.054760 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e759c2b4-7ba0-4d60-b142-8e4c3b0e6c70 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:43.055767 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e759c2b4-7ba0-4d60-b142-8e4c3b0e6c70 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:43.056476 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e759c2b4-7ba0-4d60-b142-8e4c3b0e6c70 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:43.057292 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e759c2b4-7ba0-4d60-b142-8e4c3b0e6c70 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:43.224269 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e759c2b4-7ba0-4d60-b142-8e4c3b0e6c70 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:43.232686 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e759c2b4-7ba0-4d60-b142-8e4c3b0e6c70 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.192011 Oct 04 03:30:43.233265 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 81/162] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:43 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:44.256966 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6cf728f6-ad09-4ed1-bc54-c286fc8094d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:44.257717 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6cf728f6-ad09-4ed1-bc54-c286fc8094d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:44.264299 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6cf728f6-ad09-4ed1-bc54-c286fc8094d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:44.264873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6cf728f6-ad09-4ed1-bc54-c286fc8094d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:44.265518 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6cf728f6-ad09-4ed1-bc54-c286fc8094d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:44.266372 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6cf728f6-ad09-4ed1-bc54-c286fc8094d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:44.266982 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6cf728f6-ad09-4ed1-bc54-c286fc8094d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:44.267523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6cf728f6-ad09-4ed1-bc54-c286fc8094d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:44.415934 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6cf728f6-ad09-4ed1-bc54-c286fc8094d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:44.424237 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6cf728f6-ad09-4ed1-bc54-c286fc8094d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.172079 Oct 04 03:30:44.424844 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 82/163] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:44 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:45.448338 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-02c0de0e-92dc-465d-9a71-34225d410ff2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:45.449035 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-02c0de0e-92dc-465d-9a71-34225d410ff2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:45.455348 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02c0de0e-92dc-465d-9a71-34225d410ff2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:45.455853 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02c0de0e-92dc-465d-9a71-34225d410ff2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:45.456278 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02c0de0e-92dc-465d-9a71-34225d410ff2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:45.457726 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02c0de0e-92dc-465d-9a71-34225d410ff2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:45.458181 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02c0de0e-92dc-465d-9a71-34225d410ff2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:45.458598 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02c0de0e-92dc-465d-9a71-34225d410ff2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:45.589174 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-02c0de0e-92dc-465d-9a71-34225d410ff2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:45.596895 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-02c0de0e-92dc-465d-9a71-34225d410ff2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.152275 Oct 04 03:30:45.597449 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 82/164] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:45 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:46.621315 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-5ad8f1d7-4f16-4aa6-bcd5-ce3837b4d11e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:46.621910 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-5ad8f1d7-4f16-4aa6-bcd5-ce3837b4d11e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:46.641431 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5ad8f1d7-4f16-4aa6-bcd5-ce3837b4d11e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:46.642326 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5ad8f1d7-4f16-4aa6-bcd5-ce3837b4d11e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:46.642777 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5ad8f1d7-4f16-4aa6-bcd5-ce3837b4d11e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:46.643585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5ad8f1d7-4f16-4aa6-bcd5-ce3837b4d11e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:46.644924 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5ad8f1d7-4f16-4aa6-bcd5-ce3837b4d11e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:46.645395 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5ad8f1d7-4f16-4aa6-bcd5-ce3837b4d11e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:46.865014 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-5ad8f1d7-4f16-4aa6-bcd5-ce3837b4d11e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:46.873721 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-5ad8f1d7-4f16-4aa6-bcd5-ce3837b4d11e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.256892 Oct 04 03:30:46.874295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 83/165] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:46 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:47.898460 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-66aa4024-762e-42c0-9de4-32e8d780618c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:47.899149 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-66aa4024-762e-42c0-9de4-32e8d780618c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:47.905823 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66aa4024-762e-42c0-9de4-32e8d780618c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:47.906392 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66aa4024-762e-42c0-9de4-32e8d780618c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:47.906962 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66aa4024-762e-42c0-9de4-32e8d780618c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:47.907781 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66aa4024-762e-42c0-9de4-32e8d780618c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:47.908308 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66aa4024-762e-42c0-9de4-32e8d780618c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:47.908803 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66aa4024-762e-42c0-9de4-32e8d780618c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:48.053173 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-66aa4024-762e-42c0-9de4-32e8d780618c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:48.061645 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-66aa4024-762e-42c0-9de4-32e8d780618c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.167227 Oct 04 03:30:48.062426 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 83/166] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:47 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:30:49.091759 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-5469f274-5b2a-4b68-ac54-b74af2a06765 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:49.092668 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-5469f274-5b2a-4b68-ac54-b74af2a06765 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:49.103819 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5469f274-5b2a-4b68-ac54-b74af2a06765 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:49.104550 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5469f274-5b2a-4b68-ac54-b74af2a06765 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:49.105182 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5469f274-5b2a-4b68-ac54-b74af2a06765 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:49.106082 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5469f274-5b2a-4b68-ac54-b74af2a06765 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:49.106541 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5469f274-5b2a-4b68-ac54-b74af2a06765 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:49.106960 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5469f274-5b2a-4b68-ac54-b74af2a06765 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:49.302192 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-5469f274-5b2a-4b68-ac54-b74af2a06765 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:49.314808 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-5469f274-5b2a-4b68-ac54-b74af2a06765 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.228161 Oct 04 03:30:49.315991 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 84/167] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:49 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:50.340957 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-51f3be54-fc03-47f7-8bb2-b018a5bf4938 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:50.341557 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-51f3be54-fc03-47f7-8bb2-b018a5bf4938 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:50.348744 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51f3be54-fc03-47f7-8bb2-b018a5bf4938 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:50.349313 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51f3be54-fc03-47f7-8bb2-b018a5bf4938 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:50.349904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51f3be54-fc03-47f7-8bb2-b018a5bf4938 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:50.350627 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51f3be54-fc03-47f7-8bb2-b018a5bf4938 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:50.351109 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51f3be54-fc03-47f7-8bb2-b018a5bf4938 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:50.351615 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51f3be54-fc03-47f7-8bb2-b018a5bf4938 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:50.501872 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-51f3be54-fc03-47f7-8bb2-b018a5bf4938 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:50.510500 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-51f3be54-fc03-47f7-8bb2-b018a5bf4938 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.173580 Oct 04 03:30:50.511061 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 84/168] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:50 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:51.533122 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-60df9dc3-34fd-4b19-ad31-540e3d5133d7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:51.533763 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-60df9dc3-34fd-4b19-ad31-540e3d5133d7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:51.540445 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-60df9dc3-34fd-4b19-ad31-540e3d5133d7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:51.540918 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-60df9dc3-34fd-4b19-ad31-540e3d5133d7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:51.541351 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-60df9dc3-34fd-4b19-ad31-540e3d5133d7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:51.542033 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-60df9dc3-34fd-4b19-ad31-540e3d5133d7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:51.542486 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-60df9dc3-34fd-4b19-ad31-540e3d5133d7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:51.542903 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-60df9dc3-34fd-4b19-ad31-540e3d5133d7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:51.554672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-198403821", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "networks": [{"uuid": "a4b0818c-3180-45c4-9143-947d684963d0"}]}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:51.608357 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] validate_networks() for [('a4b0818c-3180-45c4-9143-947d684963d0', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:30:51.739198 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-60df9dc3-34fd-4b19-ad31-540e3d5133d7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:51.746736 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-60df9dc3-34fd-4b19-ad31-540e3d5133d7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.217310 Oct 04 03:30:51.747658 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 85/169] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:51 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:51.996928 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:30:51.997345 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:30:51.997810 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:30:51.998214 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:30:51.998618 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:30:52.007708 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:52.008188 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:52.008618 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:52.009339 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:52.009787 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:52.010206 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:52.026914 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Getting quotas for project 5424983f421548c3b6857a0e56aa08c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:30:52.030782 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Getting quotas for user 72b10acbb8324d1e98d17fbaf7ed732a and project 5424983f421548c3b6857a0e56aa08c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:30:52.042314 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:30:52.044601 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:30:52.096174 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4d4088d0-fecb-48e6-bacd-9c48a1601c9d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546140 Oct 04 03:30:52.096980 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 85/170] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:30:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 03:30:52.108154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f0b8e6ce-b032-4373-b67a-abed8ba54f89 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:52.108758 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f0b8e6ce-b032-4373-b67a-abed8ba54f89 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:52.167660 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f0b8e6ce-b032-4373-b67a-abed8ba54f89 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:52.174722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f0b8e6ce-b032-4373-b67a-abed8ba54f89 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2" status: 200 len: 1213 microversion: 2.1 time: 0.070265 Oct 04 03:30:52.175459 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 86/171] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:52 2022] GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:52.770670 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b88070f6-0181-4c89-ad7c-4503559c37d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:52.771281 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b88070f6-0181-4c89-ad7c-4503559c37d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:52.778145 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b88070f6-0181-4c89-ad7c-4503559c37d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:52.778622 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b88070f6-0181-4c89-ad7c-4503559c37d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:52.779043 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b88070f6-0181-4c89-ad7c-4503559c37d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:52.779751 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b88070f6-0181-4c89-ad7c-4503559c37d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:52.780190 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b88070f6-0181-4c89-ad7c-4503559c37d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:52.780603 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b88070f6-0181-4c89-ad7c-4503559c37d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:52.913965 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b88070f6-0181-4c89-ad7c-4503559c37d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:52.921799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b88070f6-0181-4c89-ad7c-4503559c37d8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.155555 Oct 04 03:30:52.922339 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 86/172] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:52 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:53.198255 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b19fda9a-797e-42a2-92fb-ed651b6b3a51 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:53.198772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b19fda9a-797e-42a2-92fb-ed651b6b3a51 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:53.204617 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b19fda9a-797e-42a2-92fb-ed651b6b3a51 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:53.205098 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b19fda9a-797e-42a2-92fb-ed651b6b3a51 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:53.205531 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b19fda9a-797e-42a2-92fb-ed651b6b3a51 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:53.206220 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b19fda9a-797e-42a2-92fb-ed651b6b3a51 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:53.207589 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b19fda9a-797e-42a2-92fb-ed651b6b3a51 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:53.207929 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b19fda9a-797e-42a2-92fb-ed651b6b3a51 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:53.267263 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b19fda9a-797e-42a2-92fb-ed651b6b3a51 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:53.274789 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b19fda9a-797e-42a2-92fb-ed651b6b3a51 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2" status: 200 len: 1265 microversion: 2.1 time: 0.080441 Oct 04 03:30:53.275356 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 87/173] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:53 2022] GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:53.945192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-07979ed1-a4e0-4ff6-b0ec-c6d5729dea12 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:53.945801 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-07979ed1-a4e0-4ff6-b0ec-c6d5729dea12 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:53.952309 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-07979ed1-a4e0-4ff6-b0ec-c6d5729dea12 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:53.952797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-07979ed1-a4e0-4ff6-b0ec-c6d5729dea12 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:53.953230 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-07979ed1-a4e0-4ff6-b0ec-c6d5729dea12 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:53.953949 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-07979ed1-a4e0-4ff6-b0ec-c6d5729dea12 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:53.954582 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-07979ed1-a4e0-4ff6-b0ec-c6d5729dea12 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:53.955007 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-07979ed1-a4e0-4ff6-b0ec-c6d5729dea12 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:54.139935 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-07979ed1-a4e0-4ff6-b0ec-c6d5729dea12 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:54.149009 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-07979ed1-a4e0-4ff6-b0ec-c6d5729dea12 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.207942 Oct 04 03:30:54.149587 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 87/174] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:53 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:54.297812 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e55ef805-4f40-4677-a1bd-28336b0446c2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:54.298410 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e55ef805-4f40-4677-a1bd-28336b0446c2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:54.304591 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e55ef805-4f40-4677-a1bd-28336b0446c2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:54.305065 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e55ef805-4f40-4677-a1bd-28336b0446c2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:54.305488 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e55ef805-4f40-4677-a1bd-28336b0446c2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:54.306160 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e55ef805-4f40-4677-a1bd-28336b0446c2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:54.306651 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e55ef805-4f40-4677-a1bd-28336b0446c2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:54.307010 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e55ef805-4f40-4677-a1bd-28336b0446c2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:54.745651 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e55ef805-4f40-4677-a1bd-28336b0446c2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:54.753985 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e55ef805-4f40-4677-a1bd-28336b0446c2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2" status: 200 len: 1313 microversion: 2.1 time: 0.459687 Oct 04 03:30:54.754747 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 88/175] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:54 2022] GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 => generated 1313 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:55.174318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c74442b1-f634-44fa-bdea-af4ce893b992 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:55.174918 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c74442b1-f634-44fa-bdea-af4ce893b992 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:55.185340 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c74442b1-f634-44fa-bdea-af4ce893b992 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:55.185830 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c74442b1-f634-44fa-bdea-af4ce893b992 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:55.186255 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c74442b1-f634-44fa-bdea-af4ce893b992 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:55.186944 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c74442b1-f634-44fa-bdea-af4ce893b992 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:55.187385 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c74442b1-f634-44fa-bdea-af4ce893b992 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:55.189214 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c74442b1-f634-44fa-bdea-af4ce893b992 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:55.341547 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-1db48753-5e7d-4cbb-aead-c376dcc014b6 req-c9b8806c-6f88-4d0d-a09a-01bbe9091bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4409f789-2a1e-4660-88e3-9138d7e185a2", "tag": "79a1e7e8-8511-423c-a37b-5c86bf399709"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:55.352375 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-1db48753-5e7d-4cbb-aead-c376dcc014b6 req-c9b8806c-6f88-4d0d-a09a-01bbe9091bd6 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:55.352847 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-1db48753-5e7d-4cbb-aead-c376dcc014b6 req-c9b8806c-6f88-4d0d-a09a-01bbe9091bd6 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:55.353268 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-1db48753-5e7d-4cbb-aead-c376dcc014b6 req-c9b8806c-6f88-4d0d-a09a-01bbe9091bd6 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:55.366236 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-1db48753-5e7d-4cbb-aead-c376dcc014b6 req-c9b8806c-6f88-4d0d-a09a-01bbe9091bd6 service nova] Creating event network-changed:79a1e7e8-8511-423c-a37b-5c86bf399709 for instance 4409f789-2a1e-4660-88e3-9138d7e185a2 on hv-cinder-84914 Oct 04 03:30:55.371182 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-1db48753-5e7d-4cbb-aead-c376dcc014b6 req-c9b8806c-6f88-4d0d-a09a-01bbe9091bd6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033190 Oct 04 03:30:55.381097 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 89/176] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:30:55.466367 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c74442b1-f634-44fa-bdea-af4ce893b992 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:55.474730 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c74442b1-f634-44fa-bdea-af4ce893b992 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.304802 Oct 04 03:30:55.475304 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 88/177] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:55 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:55.777623 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-91b7a52c-520c-43d3-8595-69f258ad5f77 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:55.778311 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-91b7a52c-520c-43d3-8595-69f258ad5f77 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:55.784355 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91b7a52c-520c-43d3-8595-69f258ad5f77 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:55.784830 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91b7a52c-520c-43d3-8595-69f258ad5f77 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:55.785249 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91b7a52c-520c-43d3-8595-69f258ad5f77 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:55.785919 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91b7a52c-520c-43d3-8595-69f258ad5f77 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:55.786363 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91b7a52c-520c-43d3-8595-69f258ad5f77 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:55.786774 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91b7a52c-520c-43d3-8595-69f258ad5f77 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:55.919012 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-91b7a52c-520c-43d3-8595-69f258ad5f77 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:55.926786 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-91b7a52c-520c-43d3-8595-69f258ad5f77 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2" status: 200 len: 1313 microversion: 2.1 time: 0.153447 Oct 04 03:30:55.927357 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 90/178] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:55 2022] GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:56.498620 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6f0c915b-d647-4447-8389-61bb0ec92e67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:56.499314 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6f0c915b-d647-4447-8389-61bb0ec92e67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:56.510092 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6f0c915b-d647-4447-8389-61bb0ec92e67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:56.510815 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6f0c915b-d647-4447-8389-61bb0ec92e67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:56.511695 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6f0c915b-d647-4447-8389-61bb0ec92e67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:56.512574 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6f0c915b-d647-4447-8389-61bb0ec92e67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:56.513202 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6f0c915b-d647-4447-8389-61bb0ec92e67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:56.513775 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6f0c915b-d647-4447-8389-61bb0ec92e67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:56.663211 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6f0c915b-d647-4447-8389-61bb0ec92e67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:56.671127 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6f0c915b-d647-4447-8389-61bb0ec92e67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.176338 Oct 04 03:30:56.671697 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 89/179] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:56 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:30:56.950023 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-79e621e1-d4e5-493b-a886-076cc99bf42c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:56.950730 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-79e621e1-d4e5-493b-a886-076cc99bf42c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:56.957401 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e621e1-d4e5-493b-a886-076cc99bf42c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:56.957956 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e621e1-d4e5-493b-a886-076cc99bf42c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:56.958386 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e621e1-d4e5-493b-a886-076cc99bf42c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:56.959104 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e621e1-d4e5-493b-a886-076cc99bf42c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:56.959584 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e621e1-d4e5-493b-a886-076cc99bf42c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:56.960011 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e621e1-d4e5-493b-a886-076cc99bf42c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:57.194132 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-79e621e1-d4e5-493b-a886-076cc99bf42c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:57.202266 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-79e621e1-d4e5-493b-a886-076cc99bf42c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2" status: 200 len: 1313 microversion: 2.1 time: 0.256114 Oct 04 03:30:57.203072 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 91/180] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:56 2022] GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:30:57.697769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4eb06864-2b58-4057-93dc-ac705a5aa5ec tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:57.698375 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4eb06864-2b58-4057-93dc-ac705a5aa5ec tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:57.704728 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4eb06864-2b58-4057-93dc-ac705a5aa5ec tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:57.705206 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4eb06864-2b58-4057-93dc-ac705a5aa5ec tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:57.705636 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4eb06864-2b58-4057-93dc-ac705a5aa5ec tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:57.706999 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4eb06864-2b58-4057-93dc-ac705a5aa5ec tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:57.707543 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4eb06864-2b58-4057-93dc-ac705a5aa5ec tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:57.708001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4eb06864-2b58-4057-93dc-ac705a5aa5ec tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:57.849762 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-4eb06864-2b58-4057-93dc-ac705a5aa5ec tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:57.858410 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4eb06864-2b58-4057-93dc-ac705a5aa5ec tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.164455 Oct 04 03:30:57.859414 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 90/181] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:57 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:58.225876 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7d7e8005-6604-40dd-8b5e-f97f3719e202 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:58.226492 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-7d7e8005-6604-40dd-8b5e-f97f3719e202 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:58.232669 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7d7e8005-6604-40dd-8b5e-f97f3719e202 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:58.233329 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7d7e8005-6604-40dd-8b5e-f97f3719e202 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:58.233925 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7d7e8005-6604-40dd-8b5e-f97f3719e202 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:58.234969 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7d7e8005-6604-40dd-8b5e-f97f3719e202 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:58.235567 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7d7e8005-6604-40dd-8b5e-f97f3719e202 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:58.236095 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7d7e8005-6604-40dd-8b5e-f97f3719e202 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:58.375139 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7d7e8005-6604-40dd-8b5e-f97f3719e202 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:58.383312 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-7d7e8005-6604-40dd-8b5e-f97f3719e202 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2" status: 200 len: 1313 microversion: 2.1 time: 0.161469 Oct 04 03:30:58.383904 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 92/182] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:58 2022] GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:58.882530 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-19fe57b5-5bc6-4375-a422-9bcb41bf177e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:58.883204 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-19fe57b5-5bc6-4375-a422-9bcb41bf177e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:58.889690 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19fe57b5-5bc6-4375-a422-9bcb41bf177e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:58.890108 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19fe57b5-5bc6-4375-a422-9bcb41bf177e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:58.890536 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19fe57b5-5bc6-4375-a422-9bcb41bf177e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:58.891214 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19fe57b5-5bc6-4375-a422-9bcb41bf177e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:58.891691 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19fe57b5-5bc6-4375-a422-9bcb41bf177e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:58.892109 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19fe57b5-5bc6-4375-a422-9bcb41bf177e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:59.025274 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-19fe57b5-5bc6-4375-a422-9bcb41bf177e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:59.033155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-19fe57b5-5bc6-4375-a422-9bcb41bf177e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.154851 Oct 04 03:30:59.033904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 91/183] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:58 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:30:59.190926 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-e9276250-b036-49ed-a864-7d9eaf1de44b req-4d2731b0-d657-429d-a702-ead3ebec1393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4409f789-2a1e-4660-88e3-9138d7e185a2", "name": "network-vif-plugged", "status": "completed", "tag": "79a1e7e8-8511-423c-a37b-5c86bf399709"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:30:59.205667 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-e9276250-b036-49ed-a864-7d9eaf1de44b req-4d2731b0-d657-429d-a702-ead3ebec1393 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:59.206257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-e9276250-b036-49ed-a864-7d9eaf1de44b req-4d2731b0-d657-429d-a702-ead3ebec1393 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:59.206793 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-e9276250-b036-49ed-a864-7d9eaf1de44b req-4d2731b0-d657-429d-a702-ead3ebec1393 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:59.230176 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-e9276250-b036-49ed-a864-7d9eaf1de44b req-4d2731b0-d657-429d-a702-ead3ebec1393 service nova] Creating event network-vif-plugged:79a1e7e8-8511-423c-a37b-5c86bf399709 for instance 4409f789-2a1e-4660-88e3-9138d7e185a2 on hv-cinder-84914 Oct 04 03:30:59.236404 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-e9276250-b036-49ed-a864-7d9eaf1de44b req-4d2731b0-d657-429d-a702-ead3ebec1393 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049961 Oct 04 03:30:59.236992 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 93/184] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:30:59.408120 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-11027f61-563a-4105-9362-60ffc5d7f15d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:30:59.408723 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-11027f61-563a-4105-9362-60ffc5d7f15d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:30:59.417483 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11027f61-563a-4105-9362-60ffc5d7f15d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:59.418142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11027f61-563a-4105-9362-60ffc5d7f15d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:59.418633 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11027f61-563a-4105-9362-60ffc5d7f15d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:59.419576 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11027f61-563a-4105-9362-60ffc5d7f15d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:30:59.420030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11027f61-563a-4105-9362-60ffc5d7f15d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:30:59.420450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11027f61-563a-4105-9362-60ffc5d7f15d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:30:59.570815 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-11027f61-563a-4105-9362-60ffc5d7f15d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:30:59.578516 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-11027f61-563a-4105-9362-60ffc5d7f15d tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2" status: 200 len: 1313 microversion: 2.1 time: 0.175815 Oct 04 03:30:59.579074 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 92/185] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:30:59 2022] GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:00.061366 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e0f6ba29-4709-4251-bd12-20b83a04c1b0 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:00.062070 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e0f6ba29-4709-4251-bd12-20b83a04c1b0 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:00.069610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e0f6ba29-4709-4251-bd12-20b83a04c1b0 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:00.070099 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e0f6ba29-4709-4251-bd12-20b83a04c1b0 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:00.070535 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e0f6ba29-4709-4251-bd12-20b83a04c1b0 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:00.071245 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e0f6ba29-4709-4251-bd12-20b83a04c1b0 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:00.071729 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e0f6ba29-4709-4251-bd12-20b83a04c1b0 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:00.072157 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e0f6ba29-4709-4251-bd12-20b83a04c1b0 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:00.204901 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e0f6ba29-4709-4251-bd12-20b83a04c1b0 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:00.213165 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e0f6ba29-4709-4251-bd12-20b83a04c1b0 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.156106 Oct 04 03:31:00.213726 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 94/186] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:00 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:00.611725 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-eab74c2b-5717-4242-afda-8fc23b8c2547 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:00.611725 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-eab74c2b-5717-4242-afda-8fc23b8c2547 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:00.611725 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eab74c2b-5717-4242-afda-8fc23b8c2547 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:00.611725 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eab74c2b-5717-4242-afda-8fc23b8c2547 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:00.612474 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eab74c2b-5717-4242-afda-8fc23b8c2547 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:00.612474 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eab74c2b-5717-4242-afda-8fc23b8c2547 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:00.612474 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eab74c2b-5717-4242-afda-8fc23b8c2547 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:00.614062 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eab74c2b-5717-4242-afda-8fc23b8c2547 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:00.761087 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-eab74c2b-5717-4242-afda-8fc23b8c2547 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:00.768675 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-eab74c2b-5717-4242-afda-8fc23b8c2547 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2" status: 200 len: 1313 microversion: 2.1 time: 0.171194 Oct 04 03:31:00.769247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 93/187] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:00 2022] GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:01.236771 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f4e254bf-5cc8-46dc-a147-18fb0fc038a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:01.237378 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f4e254bf-5cc8-46dc-a147-18fb0fc038a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:01.243559 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4e254bf-5cc8-46dc-a147-18fb0fc038a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:01.244041 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4e254bf-5cc8-46dc-a147-18fb0fc038a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:01.244470 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4e254bf-5cc8-46dc-a147-18fb0fc038a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:01.245148 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4e254bf-5cc8-46dc-a147-18fb0fc038a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:01.245591 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4e254bf-5cc8-46dc-a147-18fb0fc038a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:01.246007 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4e254bf-5cc8-46dc-a147-18fb0fc038a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:01.378288 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f4e254bf-5cc8-46dc-a147-18fb0fc038a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:01.387692 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f4e254bf-5cc8-46dc-a147-18fb0fc038a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.154631 Oct 04 03:31:01.388275 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 95/188] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:01 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:01.792094 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ad615673-eb5e-4fdb-861b-eeaccb292890 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:01.792606 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ad615673-eb5e-4fdb-861b-eeaccb292890 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:01.798947 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad615673-eb5e-4fdb-861b-eeaccb292890 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:01.799429 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad615673-eb5e-4fdb-861b-eeaccb292890 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:01.799888 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad615673-eb5e-4fdb-861b-eeaccb292890 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:01.800568 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad615673-eb5e-4fdb-861b-eeaccb292890 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:01.801839 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad615673-eb5e-4fdb-861b-eeaccb292890 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:01.802275 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad615673-eb5e-4fdb-861b-eeaccb292890 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:01.806350 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:01.936264 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ad615673-eb5e-4fdb-861b-eeaccb292890 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:01.945147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ad615673-eb5e-4fdb-861b-eeaccb292890 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2" status: 200 len: 1497 microversion: 2.1 time: 0.156899 Oct 04 03:31:01.945722 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 94/189] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:01 2022] GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:02.412677 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6dcb0dac-c4a5-4826-9689-2aa69894aab8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:02.413334 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6dcb0dac-c4a5-4826-9689-2aa69894aab8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:02.415345 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:02.420884 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6dcb0dac-c4a5-4826-9689-2aa69894aab8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:02.421373 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6dcb0dac-c4a5-4826-9689-2aa69894aab8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:02.421816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6dcb0dac-c4a5-4826-9689-2aa69894aab8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:02.422501 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6dcb0dac-c4a5-4826-9689-2aa69894aab8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:02.422954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6dcb0dac-c4a5-4826-9689-2aa69894aab8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:02.423377 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6dcb0dac-c4a5-4826-9689-2aa69894aab8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:02.425543 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-71d8a3b6-7691-46e7-8f6b-3cdd5607face tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:02.426000 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-71d8a3b6-7691-46e7-8f6b-3cdd5607face tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:02.428221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:02.429082 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:02.437832 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71d8a3b6-7691-46e7-8f6b-3cdd5607face tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:02.438351 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71d8a3b6-7691-46e7-8f6b-3cdd5607face tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:02.438782 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71d8a3b6-7691-46e7-8f6b-3cdd5607face tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:02.439509 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71d8a3b6-7691-46e7-8f6b-3cdd5607face tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:02.439968 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71d8a3b6-7691-46e7-8f6b-3cdd5607face tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:02.440523 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71d8a3b6-7691-46e7-8f6b-3cdd5607face tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:02.466588 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-71d8a3b6-7691-46e7-8f6b-3cdd5607face tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:31:02.559649 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-71d8a3b6-7691-46e7-8f6b-3cdd5607face tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2" status: 204 len: 0 microversion: 2.1 time: 0.137861 Oct 04 03:31:02.563666 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 95/190] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:31:02 2022] DELETE /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 03:31:02.571450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9f38e9e6-6fa4-4c63-886b-8eef58508c22 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:02.572340 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9f38e9e6-6fa4-4c63-886b-8eef58508c22 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:02.578005 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f38e9e6-6fa4-4c63-886b-8eef58508c22 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:02.578471 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f38e9e6-6fa4-4c63-886b-8eef58508c22 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:02.578899 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f38e9e6-6fa4-4c63-886b-8eef58508c22 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:02.579610 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f38e9e6-6fa4-4c63-886b-8eef58508c22 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:02.580060 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f38e9e6-6fa4-4c63-886b-8eef58508c22 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:02.580167 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6dcb0dac-c4a5-4826-9689-2aa69894aab8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:02.580478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f38e9e6-6fa4-4c63-886b-8eef58508c22 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:02.591178 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6dcb0dac-c4a5-4826-9689-2aa69894aab8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.183043 Oct 04 03:31:02.592109 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 96/191] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:02 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:02.726965 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9f38e9e6-6fa4-4c63-886b-8eef58508c22 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:02.734984 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9f38e9e6-6fa4-4c63-886b-8eef58508c22 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2" status: 200 len: 1503 microversion: 2.1 time: 0.168554 Oct 04 03:31:02.735853 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 96/192] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:02 2022] GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:03.616681 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-1c61a66e-78da-43f0-864a-a4e58a0830da tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:03.617272 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-1c61a66e-78da-43f0-864a-a4e58a0830da tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:03.623285 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1c61a66e-78da-43f0-864a-a4e58a0830da tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:03.623838 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1c61a66e-78da-43f0-864a-a4e58a0830da tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:03.624261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1c61a66e-78da-43f0-864a-a4e58a0830da tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:03.624930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1c61a66e-78da-43f0-864a-a4e58a0830da tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:03.625370 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1c61a66e-78da-43f0-864a-a4e58a0830da tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:03.625893 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1c61a66e-78da-43f0-864a-a4e58a0830da tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:03.759660 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5d34d78d-7e41-4e33-89fb-dcc17a7d9239 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:03.760891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5d34d78d-7e41-4e33-89fb-dcc17a7d9239 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:03.767298 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d34d78d-7e41-4e33-89fb-dcc17a7d9239 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:03.767822 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d34d78d-7e41-4e33-89fb-dcc17a7d9239 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:03.768249 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-1c61a66e-78da-43f0-864a-a4e58a0830da tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:03.768380 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d34d78d-7e41-4e33-89fb-dcc17a7d9239 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:03.769773 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d34d78d-7e41-4e33-89fb-dcc17a7d9239 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:03.770233 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d34d78d-7e41-4e33-89fb-dcc17a7d9239 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:03.771357 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d34d78d-7e41-4e33-89fb-dcc17a7d9239 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:03.777820 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-1c61a66e-78da-43f0-864a-a4e58a0830da tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.165621 Oct 04 03:31:03.779519 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 97/193] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:03 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:03.919227 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5d34d78d-7e41-4e33-89fb-dcc17a7d9239 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:03.928031 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5d34d78d-7e41-4e33-89fb-dcc17a7d9239 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2" status: 200 len: 1503 microversion: 2.1 time: 0.173452 Oct 04 03:31:03.928570 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 97/194] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:03 2022] GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:31:04.809021 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d32b5b32-c0cf-49f0-a575-231075964491 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:04.815356 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d32b5b32-c0cf-49f0-a575-231075964491 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:04.823173 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d32b5b32-c0cf-49f0-a575-231075964491 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:04.823298 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d32b5b32-c0cf-49f0-a575-231075964491 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:04.823904 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d32b5b32-c0cf-49f0-a575-231075964491 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:04.824749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d32b5b32-c0cf-49f0-a575-231075964491 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:04.825204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d32b5b32-c0cf-49f0-a575-231075964491 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:04.825671 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d32b5b32-c0cf-49f0-a575-231075964491 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:04.944694 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-8f4f6ed4-ff43-4213-a6ff-714e110de428 req-5507d5a1-3b46-44b6-90d7-92b2b5a78ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4409f789-2a1e-4660-88e3-9138d7e185a2", "name": "network-vif-deleted", "tag": "79a1e7e8-8511-423c-a37b-5c86bf399709"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:04.958690 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-8f4f6ed4-ff43-4213-a6ff-714e110de428 req-5507d5a1-3b46-44b6-90d7-92b2b5a78ecb service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:04.959171 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-8f4f6ed4-ff43-4213-a6ff-714e110de428 req-5507d5a1-3b46-44b6-90d7-92b2b5a78ecb service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:04.960627 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-8f4f6ed4-ff43-4213-a6ff-714e110de428 req-5507d5a1-3b46-44b6-90d7-92b2b5a78ecb service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:04.973786 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-8f4f6ed4-ff43-4213-a6ff-714e110de428 req-5507d5a1-3b46-44b6-90d7-92b2b5a78ecb service nova] Creating event network-vif-deleted:79a1e7e8-8511-423c-a37b-5c86bf399709 for instance 4409f789-2a1e-4660-88e3-9138d7e185a2 on hv-cinder-84914 Oct 04 03:31:04.979164 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-8f4f6ed4-ff43-4213-a6ff-714e110de428 req-5507d5a1-3b46-44b6-90d7-92b2b5a78ecb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039340 Oct 04 03:31:04.979811 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 98/195] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:31:04.984913 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0bad6879-3690-4732-be01-13fbdd5aea89 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:04.985497 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0bad6879-3690-4732-be01-13fbdd5aea89 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:04.991837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bad6879-3690-4732-be01-13fbdd5aea89 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:04.992322 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bad6879-3690-4732-be01-13fbdd5aea89 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:04.992752 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bad6879-3690-4732-be01-13fbdd5aea89 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:04.993443 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bad6879-3690-4732-be01-13fbdd5aea89 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:04.993897 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bad6879-3690-4732-be01-13fbdd5aea89 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:04.994444 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bad6879-3690-4732-be01-13fbdd5aea89 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:05.027440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d32b5b32-c0cf-49f0-a575-231075964491 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:05.037148 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d32b5b32-c0cf-49f0-a575-231075964491 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.231996 Oct 04 03:31:05.038566 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 98/196] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:04 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:05.067368 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-0bad6879-3690-4732-be01-13fbdd5aea89 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:05.076052 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0bad6879-3690-4732-be01-13fbdd5aea89 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2" status: 200 len: 1298 microversion: 2.1 time: 0.094990 Oct 04 03:31:05.076627 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 99/197] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:04 2022] GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:06.062631 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-cefc288f-0ee8-49a3-923d-764220c25a3e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:06.063233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-cefc288f-0ee8-49a3-923d-764220c25a3e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:06.070406 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cefc288f-0ee8-49a3-923d-764220c25a3e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:06.070887 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cefc288f-0ee8-49a3-923d-764220c25a3e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:06.071323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cefc288f-0ee8-49a3-923d-764220c25a3e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:06.072037 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cefc288f-0ee8-49a3-923d-764220c25a3e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:06.072493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cefc288f-0ee8-49a3-923d-764220c25a3e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:06.072922 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cefc288f-0ee8-49a3-923d-764220c25a3e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:06.100913 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f919916b-52f8-4a3d-beb4-d75820e49981 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:06.101605 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f919916b-52f8-4a3d-beb4-d75820e49981 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: 4409f789-2a1e-4660-88e3-9138d7e185a2] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:06.104649 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:06.110313 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f919916b-52f8-4a3d-beb4-d75820e49981 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:06.110796 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f919916b-52f8-4a3d-beb4-d75820e49981 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:06.111228 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f919916b-52f8-4a3d-beb4-d75820e49981 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:06.111954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f919916b-52f8-4a3d-beb4-d75820e49981 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:06.112402 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f919916b-52f8-4a3d-beb4-d75820e49981 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:06.112821 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f919916b-52f8-4a3d-beb4-d75820e49981 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:06.131165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-f919916b-52f8-4a3d-beb4-d75820e49981 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] HTTP exception thrown: Instance 4409f789-2a1e-4660-88e3-9138d7e185a2 could not be found. Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f919916b-52f8-4a3d-beb4-d75820e49981 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Request method failure captured: Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 HTTP/1.1 Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6jp1QSPwCmeQZ9yQLj88xsPnOi0TWR0-RSAxuSgGnPqZZt6le_A9a2wLQ8dwFAm4CGWnwJpXABhSemXjPONShOpvgOr5sHAZf7QNlqP66mWKLKtGoxMuZPPhf-UkuOTfBiP_FQwFeASPKh_Y2SGCr61ZV-iaJXp5LpIFpfbYd7VeLU Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: 5424983f421548c3b6857a0e56aa08c6 Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-VolumesActionsTest-1176679404 Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:31:06.133672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:31:06.136079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5424983f421548c3b6857a0e56aa08c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5424983f421548c3b6857a0e56aa08c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5424983f421548c3b6857a0e56aa08c6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5424983f421548c3b6857a0e56aa08c6"}]}] Oct 04 03:31:06.136079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-VolumesActionsTest-1176679404 Oct 04 03:31:06.136079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: 5424983f421548c3b6857a0e56aa08c6 Oct 04 03:31:06.136079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-VolumesActionsTest-1176679404 Oct 04 03:31:06.136079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-VolumesActionsTest-1176679404-project Oct 04 03:31:06.136079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:31:06.136079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:31:06.136079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: 72b10acbb8324d1e98d17fbaf7ed732a Oct 04 03:31:06.136079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-VolumesActionsTest-1176679404-project Oct 04 03:31:06.136079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:31:06.136079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance 4409f789-2a1e-4660-88e3-9138d7e185a2 could not be found. Oct 04 03:31:06.136079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '4409f789-2a1e-4660-88e3-9138d7e185a2'} Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4409f789-2a1e-4660-88e3-9138d7e185a2 could not be found. Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:31:06.136769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4409f789-2a1e-4660-88e3-9138d7e185a2 could not be found. Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4409f789-2a1e-4660-88e3-9138d7e185a2 could not be found. Oct 04 03:31:06.138992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:31:06.140005 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f919916b-52f8-4a3d-beb4-d75820e49981 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Returning 404 to user: Instance 4409f789-2a1e-4660-88e3-9138d7e185a2 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:31:06.140005 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f919916b-52f8-4a3d-beb4-d75820e49981 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2" status: 404 len: 111 microversion: 2.1 time: 0.039795 Oct 04 03:31:06.147533 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 100/198] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:06 2022] GET /compute/v2.1/servers/4409f789-2a1e-4660-88e3-9138d7e185a2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 03:31:06.189794 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1952597548", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "networks": [{"uuid": "a4b0818c-3180-45c4-9143-947d684963d0"}]}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:06.215362 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-cefc288f-0ee8-49a3-923d-764220c25a3e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:06.217828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=100 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:06.225865 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-cefc288f-0ee8-49a3-923d-764220c25a3e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.166404 Oct 04 03:31:06.226654 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 99/199] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:06 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:06.249092 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] validate_networks() for [('a4b0818c-3180-45c4-9143-947d684963d0', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:31:06.604898 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:31:06.605150 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:31:06.605619 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:31:06.606028 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:31:06.606435 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:31:06.615146 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:06.615791 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:06.616554 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:06.617287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:06.617744 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:06.618161 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:06.636147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Getting quotas for project 5424983f421548c3b6857a0e56aa08c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:31:06.641338 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Getting quotas for user 72b10acbb8324d1e98d17fbaf7ed732a and project 5424983f421548c3b6857a0e56aa08c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:31:06.652966 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:31:06.655266 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:31:06.705324 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1ad132dd-e1c4-4bc7-99de-264542a7c2a7 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519439 Oct 04 03:31:06.706148 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 101/200] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:31:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 03:31:06.717857 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-39048a95-0be9-438a-8017-269db0d0485a tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:06.718473 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-39048a95-0be9-438a-8017-269db0d0485a tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:06.778361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-39048a95-0be9-438a-8017-269db0d0485a tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:06.785145 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-39048a95-0be9-438a-8017-269db0d0485a tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 200 len: 1214 microversion: 2.1 time: 0.071246 Oct 04 03:31:06.786014 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 100/201] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:06 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:07.252724 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9c0a3c62-25b7-467c-9a66-e5f5d97df6f8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:07.253405 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9c0a3c62-25b7-467c-9a66-e5f5d97df6f8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:07.263000 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c0a3c62-25b7-467c-9a66-e5f5d97df6f8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:07.264463 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c0a3c62-25b7-467c-9a66-e5f5d97df6f8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:07.265339 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c0a3c62-25b7-467c-9a66-e5f5d97df6f8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:07.266182 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c0a3c62-25b7-467c-9a66-e5f5d97df6f8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:07.266770 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c0a3c62-25b7-467c-9a66-e5f5d97df6f8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:07.268659 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c0a3c62-25b7-467c-9a66-e5f5d97df6f8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:07.414681 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9c0a3c62-25b7-467c-9a66-e5f5d97df6f8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:07.425136 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9c0a3c62-25b7-467c-9a66-e5f5d97df6f8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.176920 Oct 04 03:31:07.426318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 102/202] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:07 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:07.809167 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a5806263-9e6d-46a1-bca4-90510bb966b0 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:07.809704 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a5806263-9e6d-46a1-bca4-90510bb966b0 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:07.816233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a5806263-9e6d-46a1-bca4-90510bb966b0 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:07.816831 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a5806263-9e6d-46a1-bca4-90510bb966b0 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:07.817375 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a5806263-9e6d-46a1-bca4-90510bb966b0 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:07.818426 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a5806263-9e6d-46a1-bca4-90510bb966b0 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:07.818874 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a5806263-9e6d-46a1-bca4-90510bb966b0 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:07.819300 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a5806263-9e6d-46a1-bca4-90510bb966b0 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:07.886837 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a5806263-9e6d-46a1-bca4-90510bb966b0 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:07.894624 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a5806263-9e6d-46a1-bca4-90510bb966b0 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 200 len: 1266 microversion: 2.1 time: 0.089319 Oct 04 03:31:07.895310 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 101/203] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:07 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:08.449354 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cc5b130f-b476-456f-b6e4-37aaf31c3c81 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:08.449972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cc5b130f-b476-456f-b6e4-37aaf31c3c81 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:08.456463 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc5b130f-b476-456f-b6e4-37aaf31c3c81 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:08.456948 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc5b130f-b476-456f-b6e4-37aaf31c3c81 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:08.457381 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc5b130f-b476-456f-b6e4-37aaf31c3c81 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:08.458080 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc5b130f-b476-456f-b6e4-37aaf31c3c81 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:08.458530 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc5b130f-b476-456f-b6e4-37aaf31c3c81 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:08.458953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc5b130f-b476-456f-b6e4-37aaf31c3c81 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:08.677785 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-cc5b130f-b476-456f-b6e4-37aaf31c3c81 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:08.686315 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cc5b130f-b476-456f-b6e4-37aaf31c3c81 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.240797 Oct 04 03:31:08.686888 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 103/204] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:08 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:31:08.918867 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a070a636-d731-4bec-a9c3-43b3275fb00c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:08.919856 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a070a636-d731-4bec-a9c3-43b3275fb00c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:08.929050 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a070a636-d731-4bec-a9c3-43b3275fb00c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:08.929562 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a070a636-d731-4bec-a9c3-43b3275fb00c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:08.929996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a070a636-d731-4bec-a9c3-43b3275fb00c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:08.930731 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a070a636-d731-4bec-a9c3-43b3275fb00c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:08.931182 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a070a636-d731-4bec-a9c3-43b3275fb00c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:08.931628 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a070a636-d731-4bec-a9c3-43b3275fb00c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:09.389138 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a070a636-d731-4bec-a9c3-43b3275fb00c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:09.396985 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a070a636-d731-4bec-a9c3-43b3275fb00c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 200 len: 1314 microversion: 2.1 time: 0.482013 Oct 04 03:31:09.397590 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 102/205] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:08 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:09.710700 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2cd140cc-9e5b-4065-958b-33f1a9b0f0e4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:09.711987 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2cd140cc-9e5b-4065-958b-33f1a9b0f0e4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:09.718409 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2cd140cc-9e5b-4065-958b-33f1a9b0f0e4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:09.718957 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2cd140cc-9e5b-4065-958b-33f1a9b0f0e4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:09.719451 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2cd140cc-9e5b-4065-958b-33f1a9b0f0e4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:09.720163 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2cd140cc-9e5b-4065-958b-33f1a9b0f0e4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:09.720606 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2cd140cc-9e5b-4065-958b-33f1a9b0f0e4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:09.721025 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2cd140cc-9e5b-4065-958b-33f1a9b0f0e4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:09.916930 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2cd140cc-9e5b-4065-958b-33f1a9b0f0e4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:09.925739 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2cd140cc-9e5b-4065-958b-33f1a9b0f0e4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.218554 Oct 04 03:31:09.926046 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 104/206] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:09 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:09.971969 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-52a44739-3b48-4672-9217-3a38b2e48edb req-03ed0990-ea93-465c-bbdf-914730fc3f51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce8ceee-7136-4e9c-978f-41974b8c49df", "tag": "7dc0cf11-878d-4709-b571-60406c4e5365"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:09.982730 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-52a44739-3b48-4672-9217-3a38b2e48edb req-03ed0990-ea93-465c-bbdf-914730fc3f51 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:09.983236 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-52a44739-3b48-4672-9217-3a38b2e48edb req-03ed0990-ea93-465c-bbdf-914730fc3f51 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:09.984092 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-52a44739-3b48-4672-9217-3a38b2e48edb req-03ed0990-ea93-465c-bbdf-914730fc3f51 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:10.001752 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-52a44739-3b48-4672-9217-3a38b2e48edb req-03ed0990-ea93-465c-bbdf-914730fc3f51 service nova] Creating event network-changed:7dc0cf11-878d-4709-b571-60406c4e5365 for instance fce8ceee-7136-4e9c-978f-41974b8c49df on hv-cinder-84914 Oct 04 03:31:10.010408 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-52a44739-3b48-4672-9217-3a38b2e48edb req-03ed0990-ea93-465c-bbdf-914730fc3f51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041460 Oct 04 03:31:10.011807 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 103/207] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:31:10.419770 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e12897a8-2894-4864-bbe2-22fdd50329f2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:10.420268 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e12897a8-2894-4864-bbe2-22fdd50329f2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:10.426259 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e12897a8-2894-4864-bbe2-22fdd50329f2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:10.426736 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e12897a8-2894-4864-bbe2-22fdd50329f2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:10.427165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e12897a8-2894-4864-bbe2-22fdd50329f2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:10.427900 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e12897a8-2894-4864-bbe2-22fdd50329f2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:10.428580 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e12897a8-2894-4864-bbe2-22fdd50329f2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:10.429005 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e12897a8-2894-4864-bbe2-22fdd50329f2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:10.559113 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e12897a8-2894-4864-bbe2-22fdd50329f2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:10.567249 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e12897a8-2894-4864-bbe2-22fdd50329f2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 200 len: 1314 microversion: 2.1 time: 0.151422 Oct 04 03:31:10.567844 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 105/208] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:10 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:10.949915 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c46baea3-61c2-459a-bd2b-010b84b90655 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:10.950603 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c46baea3-61c2-459a-bd2b-010b84b90655 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:10.956556 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c46baea3-61c2-459a-bd2b-010b84b90655 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:10.957034 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c46baea3-61c2-459a-bd2b-010b84b90655 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:10.957466 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c46baea3-61c2-459a-bd2b-010b84b90655 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:10.958141 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c46baea3-61c2-459a-bd2b-010b84b90655 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:10.958580 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c46baea3-61c2-459a-bd2b-010b84b90655 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:10.958995 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c46baea3-61c2-459a-bd2b-010b84b90655 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:11.093051 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c46baea3-61c2-459a-bd2b-010b84b90655 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:11.101181 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c46baea3-61c2-459a-bd2b-010b84b90655 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.155790 Oct 04 03:31:11.101790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 104/209] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:10 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:11.590169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6be117f7-4752-4e8e-9169-39aa4d704ec6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:11.590856 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6be117f7-4752-4e8e-9169-39aa4d704ec6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:11.598074 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6be117f7-4752-4e8e-9169-39aa4d704ec6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:11.598556 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6be117f7-4752-4e8e-9169-39aa4d704ec6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:11.598979 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6be117f7-4752-4e8e-9169-39aa4d704ec6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:11.599705 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6be117f7-4752-4e8e-9169-39aa4d704ec6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:11.600842 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6be117f7-4752-4e8e-9169-39aa4d704ec6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:11.601258 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6be117f7-4752-4e8e-9169-39aa4d704ec6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:11.735105 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6be117f7-4752-4e8e-9169-39aa4d704ec6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:11.743591 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6be117f7-4752-4e8e-9169-39aa4d704ec6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 200 len: 1314 microversion: 2.1 time: 0.157226 Oct 04 03:31:11.744145 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 106/210] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:11 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:12.124936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-acea3e73-5f25-4d95-970d-479525d8f64e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:12.125582 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-acea3e73-5f25-4d95-970d-479525d8f64e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:12.127573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=52 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:12.132667 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-acea3e73-5f25-4d95-970d-479525d8f64e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:12.133148 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-acea3e73-5f25-4d95-970d-479525d8f64e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:12.133574 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-acea3e73-5f25-4d95-970d-479525d8f64e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:12.134272 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-acea3e73-5f25-4d95-970d-479525d8f64e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:12.134715 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-acea3e73-5f25-4d95-970d-479525d8f64e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:12.135127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-acea3e73-5f25-4d95-970d-479525d8f64e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:12.281390 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-acea3e73-5f25-4d95-970d-479525d8f64e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:12.290518 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-acea3e73-5f25-4d95-970d-479525d8f64e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.169137 Oct 04 03:31:12.291997 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 105/211] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:12 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:12.766196 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-93d1aa0e-618b-46a0-a10e-a62af32dd0d2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:12.766832 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-93d1aa0e-618b-46a0-a10e-a62af32dd0d2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:12.773674 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-93d1aa0e-618b-46a0-a10e-a62af32dd0d2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:12.774164 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-93d1aa0e-618b-46a0-a10e-a62af32dd0d2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:12.774597 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-93d1aa0e-618b-46a0-a10e-a62af32dd0d2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:12.775298 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-93d1aa0e-618b-46a0-a10e-a62af32dd0d2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:12.775777 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-93d1aa0e-618b-46a0-a10e-a62af32dd0d2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:12.776202 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-93d1aa0e-618b-46a0-a10e-a62af32dd0d2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:12.908344 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-93d1aa0e-618b-46a0-a10e-a62af32dd0d2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:12.917052 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-93d1aa0e-618b-46a0-a10e-a62af32dd0d2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 200 len: 1314 microversion: 2.1 time: 0.154656 Oct 04 03:31:12.917628 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 107/212] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:12 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:13.314688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-98695667-e31c-4f3b-9cc6-ed397567b598 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:13.315956 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-98695667-e31c-4f3b-9cc6-ed397567b598 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:13.323197 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-98695667-e31c-4f3b-9cc6-ed397567b598 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:13.323709 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-98695667-e31c-4f3b-9cc6-ed397567b598 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:13.324134 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-98695667-e31c-4f3b-9cc6-ed397567b598 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:13.324817 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-98695667-e31c-4f3b-9cc6-ed397567b598 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:13.325259 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-98695667-e31c-4f3b-9cc6-ed397567b598 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:13.325677 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-98695667-e31c-4f3b-9cc6-ed397567b598 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:13.574052 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-98695667-e31c-4f3b-9cc6-ed397567b598 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:13.581812 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-98695667-e31c-4f3b-9cc6-ed397567b598 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1522 microversion: 2.1 time: 0.271492 Oct 04 03:31:13.583873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 106/213] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:13 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:13.943945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-49ec1c38-a98f-42e6-9115-57f873e95994 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:13.944476 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-49ec1c38-a98f-42e6-9115-57f873e95994 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:13.950637 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-49ec1c38-a98f-42e6-9115-57f873e95994 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:13.951110 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-49ec1c38-a98f-42e6-9115-57f873e95994 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:13.951595 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-49ec1c38-a98f-42e6-9115-57f873e95994 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:13.952279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-49ec1c38-a98f-42e6-9115-57f873e95994 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:13.952719 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-49ec1c38-a98f-42e6-9115-57f873e95994 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:13.953131 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-49ec1c38-a98f-42e6-9115-57f873e95994 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:14.086112 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-49ec1c38-a98f-42e6-9115-57f873e95994 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:14.094425 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-49ec1c38-a98f-42e6-9115-57f873e95994 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 200 len: 1314 microversion: 2.1 time: 0.154645 Oct 04 03:31:14.095000 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 108/214] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:13 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:14.605103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-4e3faf61-d151-45af-8a4c-d7287a4c4e51 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:14.605829 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-4e3faf61-d151-45af-8a4c-d7287a4c4e51 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:14.611889 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4e3faf61-d151-45af-8a4c-d7287a4c4e51 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:14.612364 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4e3faf61-d151-45af-8a4c-d7287a4c4e51 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:14.612789 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4e3faf61-d151-45af-8a4c-d7287a4c4e51 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:14.613476 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4e3faf61-d151-45af-8a4c-d7287a4c4e51 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:14.613920 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4e3faf61-d151-45af-8a4c-d7287a4c4e51 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:14.614333 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4e3faf61-d151-45af-8a4c-d7287a4c4e51 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:14.752879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4e3faf61-d151-45af-8a4c-d7287a4c4e51 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:14.761460 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-4e3faf61-d151-45af-8a4c-d7287a4c4e51 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1502 microversion: 2.1 time: 0.160338 Oct 04 03:31:14.762044 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 107/215] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:14 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:14.785217 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-29e06511-e987-420c-a817-7c8fa134b66c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:14.785905 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-29e06511-e987-420c-a817-7c8fa134b66c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:14.792298 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-29e06511-e987-420c-a817-7c8fa134b66c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:14.792950 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-29e06511-e987-420c-a817-7c8fa134b66c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:14.793388 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-29e06511-e987-420c-a817-7c8fa134b66c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:14.795091 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-29e06511-e987-420c-a817-7c8fa134b66c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:14.795091 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-29e06511-e987-420c-a817-7c8fa134b66c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:14.795091 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-29e06511-e987-420c-a817-7c8fa134b66c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:14.949018 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-29e06511-e987-420c-a817-7c8fa134b66c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:14.957236 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-29e06511-e987-420c-a817-7c8fa134b66c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1516 microversion: 2.1 time: 0.176408 Oct 04 03:31:14.957824 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 109/216] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:14 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:15.118190 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a29aaa9f-157a-4ef4-b73c-5f4db185c96c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:15.118935 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a29aaa9f-157a-4ef4-b73c-5f4db185c96c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:15.125095 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a29aaa9f-157a-4ef4-b73c-5f4db185c96c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:15.125610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a29aaa9f-157a-4ef4-b73c-5f4db185c96c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:15.126136 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a29aaa9f-157a-4ef4-b73c-5f4db185c96c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:15.126655 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a29aaa9f-157a-4ef4-b73c-5f4db185c96c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:15.127254 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a29aaa9f-157a-4ef4-b73c-5f4db185c96c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:15.127845 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a29aaa9f-157a-4ef4-b73c-5f4db185c96c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:15.254070 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-97dc4bbd-05ce-48b1-8c19-ead31c4b49ab req-0c113ca2-a5f1-4a51-b713-19f386d7a8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce8ceee-7136-4e9c-978f-41974b8c49df", "name": "network-vif-plugged", "status": "completed", "tag": "7dc0cf11-878d-4709-b571-60406c4e5365"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:15.284834 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-97dc4bbd-05ce-48b1-8c19-ead31c4b49ab req-0c113ca2-a5f1-4a51-b713-19f386d7a8f6 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:15.285384 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-97dc4bbd-05ce-48b1-8c19-ead31c4b49ab req-0c113ca2-a5f1-4a51-b713-19f386d7a8f6 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:15.287366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-97dc4bbd-05ce-48b1-8c19-ead31c4b49ab req-0c113ca2-a5f1-4a51-b713-19f386d7a8f6 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:15.303719 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-97dc4bbd-05ce-48b1-8c19-ead31c4b49ab req-0c113ca2-a5f1-4a51-b713-19f386d7a8f6 service nova] Creating event network-vif-plugged:7dc0cf11-878d-4709-b571-60406c4e5365 for instance fce8ceee-7136-4e9c-978f-41974b8c49df on hv-cinder-84914 Oct 04 03:31:15.305860 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a29aaa9f-157a-4ef4-b73c-5f4db185c96c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:15.311236 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-97dc4bbd-05ce-48b1-8c19-ead31c4b49ab req-0c113ca2-a5f1-4a51-b713-19f386d7a8f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060979 Oct 04 03:31:15.312382 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 110/217] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:31:15.316720 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a29aaa9f-157a-4ef4-b73c-5f4db185c96c tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 200 len: 1314 microversion: 2.1 time: 0.202644 Oct 04 03:31:15.321201 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 108/218] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:15 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:16.345124 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-abe7a82b-a5eb-41a8-a0fd-de981351621f tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:16.345907 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-abe7a82b-a5eb-41a8-a0fd-de981351621f tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:16.353232 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abe7a82b-a5eb-41a8-a0fd-de981351621f tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:16.353716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abe7a82b-a5eb-41a8-a0fd-de981351621f tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:16.354137 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abe7a82b-a5eb-41a8-a0fd-de981351621f tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:16.354820 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abe7a82b-a5eb-41a8-a0fd-de981351621f tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:16.355263 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abe7a82b-a5eb-41a8-a0fd-de981351621f tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:16.355710 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abe7a82b-a5eb-41a8-a0fd-de981351621f tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:16.512622 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e969355f-63d5-4a42-b173-7a8d1a85197c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:16.516740 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-abe7a82b-a5eb-41a8-a0fd-de981351621f tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:16.517046 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e969355f-63d5-4a42-b173-7a8d1a85197c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:16.520990 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:16.524530 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e969355f-63d5-4a42-b173-7a8d1a85197c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:16.525354 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e969355f-63d5-4a42-b173-7a8d1a85197c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:16.525831 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e969355f-63d5-4a42-b173-7a8d1a85197c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:16.526692 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e969355f-63d5-4a42-b173-7a8d1a85197c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:16.526894 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-abe7a82b-a5eb-41a8-a0fd-de981351621f tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 200 len: 1314 microversion: 2.1 time: 0.185982 Oct 04 03:31:16.527159 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e969355f-63d5-4a42-b173-7a8d1a85197c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:16.527612 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e969355f-63d5-4a42-b173-7a8d1a85197c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:16.528095 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 111/219] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:16 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:16.551575 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-e969355f-63d5-4a42-b173-7a8d1a85197c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lazy-loading 'flavor' on Instance uuid 05277cf6-48c9-4eba-ae7a-4c7023431f1e {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:31:16.695287 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e969355f-63d5-4a42-b173-7a8d1a85197c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "POST /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e/action" status: 200 len: 32 microversion: 2.1 time: 0.186328 Oct 04 03:31:16.699530 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 109/220] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Oct 4 03:31:16 2022] POST /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 03:31:16.706341 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0222888a-06fa-473d-a6c1-3017b5f9cd80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:16.707576 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0222888a-06fa-473d-a6c1-3017b5f9cd80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:16.713019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:16.713930 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:16.715761 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0222888a-06fa-473d-a6c1-3017b5f9cd80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:16.716446 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0222888a-06fa-473d-a6c1-3017b5f9cd80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:16.717293 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0222888a-06fa-473d-a6c1-3017b5f9cd80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:16.718326 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0222888a-06fa-473d-a6c1-3017b5f9cd80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:16.719090 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0222888a-06fa-473d-a6c1-3017b5f9cd80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:16.720399 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0222888a-06fa-473d-a6c1-3017b5f9cd80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:16.957300 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-0222888a-06fa-473d-a6c1-3017b5f9cd80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:16.964578 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0222888a-06fa-473d-a6c1-3017b5f9cd80 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.263109 Oct 04 03:31:16.975133 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 112/221] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:16 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:17.359531 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:17.363743 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-45ff273b-96f7-43df-9ce0-d5ed0a1df9e7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:17.364440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-45ff273b-96f7-43df-9ce0-d5ed0a1df9e7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:17.371027 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-45ff273b-96f7-43df-9ce0-d5ed0a1df9e7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:17.371450 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-45ff273b-96f7-43df-9ce0-d5ed0a1df9e7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:17.371913 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-45ff273b-96f7-43df-9ce0-d5ed0a1df9e7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:17.372589 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-45ff273b-96f7-43df-9ce0-d5ed0a1df9e7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:17.373039 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-45ff273b-96f7-43df-9ce0-d5ed0a1df9e7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:17.373455 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-45ff273b-96f7-43df-9ce0-d5ed0a1df9e7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:17.398518 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-45ff273b-96f7-43df-9ce0-d5ed0a1df9e7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/ips" status: 200 len: 145 microversion: 2.1 time: 0.039496 Oct 04 03:31:17.399124 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 110/222] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Oct 4 03:31:17 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:31:17.549154 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4fd1a0fb-aece-48bf-8e58-f5b25bcbdd7a tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:17.549766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4fd1a0fb-aece-48bf-8e58-f5b25bcbdd7a tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:17.556678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4fd1a0fb-aece-48bf-8e58-f5b25bcbdd7a tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:17.557165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4fd1a0fb-aece-48bf-8e58-f5b25bcbdd7a tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:17.557598 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4fd1a0fb-aece-48bf-8e58-f5b25bcbdd7a tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:17.558292 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4fd1a0fb-aece-48bf-8e58-f5b25bcbdd7a tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:17.558742 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4fd1a0fb-aece-48bf-8e58-f5b25bcbdd7a tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:17.559166 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4fd1a0fb-aece-48bf-8e58-f5b25bcbdd7a tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:17.943796 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-4fd1a0fb-aece-48bf-8e58-f5b25bcbdd7a tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:17.952652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4fd1a0fb-aece-48bf-8e58-f5b25bcbdd7a tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 200 len: 1314 microversion: 2.1 time: 0.407248 Oct 04 03:31:17.953226 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 113/223] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:17 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:17.987421 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2465df08-8b81-4d66-a560-7a94c784f431 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:17.988075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-2465df08-8b81-4d66-a560-7a94c784f431 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:17.994741 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2465df08-8b81-4d66-a560-7a94c784f431 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:17.995220 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2465df08-8b81-4d66-a560-7a94c784f431 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:17.995714 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2465df08-8b81-4d66-a560-7a94c784f431 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:17.996407 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2465df08-8b81-4d66-a560-7a94c784f431 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:17.996857 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2465df08-8b81-4d66-a560-7a94c784f431 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:17.997277 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2465df08-8b81-4d66-a560-7a94c784f431 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:18.180326 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-2465df08-8b81-4d66-a560-7a94c784f431 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:18.189189 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2465df08-8b81-4d66-a560-7a94c784f431 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.205513 Oct 04 03:31:18.190094 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 111/224] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:17 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:18.977349 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0d9ca83b-37d9-45bb-8ba6-c7e38a691560 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:18.979395 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0d9ca83b-37d9-45bb-8ba6-c7e38a691560 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:18.986983 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d9ca83b-37d9-45bb-8ba6-c7e38a691560 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:18.987768 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d9ca83b-37d9-45bb-8ba6-c7e38a691560 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:18.988493 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d9ca83b-37d9-45bb-8ba6-c7e38a691560 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:18.989465 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d9ca83b-37d9-45bb-8ba6-c7e38a691560 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:18.989914 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d9ca83b-37d9-45bb-8ba6-c7e38a691560 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:18.990332 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d9ca83b-37d9-45bb-8ba6-c7e38a691560 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:19.144323 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-0d9ca83b-37d9-45bb-8ba6-c7e38a691560 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:19.153310 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0d9ca83b-37d9-45bb-8ba6-c7e38a691560 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 200 len: 1499 microversion: 2.1 time: 0.181780 Oct 04 03:31:19.153885 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 114/225] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:18 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 1499 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:19.217471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9bb647d3-58f6-41cb-974c-ee709539a94a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:19.218086 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-9bb647d3-58f6-41cb-974c-ee709539a94a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:19.226430 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9bb647d3-58f6-41cb-974c-ee709539a94a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:19.226922 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9bb647d3-58f6-41cb-974c-ee709539a94a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:19.227872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9bb647d3-58f6-41cb-974c-ee709539a94a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:19.228667 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9bb647d3-58f6-41cb-974c-ee709539a94a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:19.229119 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9bb647d3-58f6-41cb-974c-ee709539a94a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:19.229810 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9bb647d3-58f6-41cb-974c-ee709539a94a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:19.399097 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-9bb647d3-58f6-41cb-974c-ee709539a94a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:19.408614 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-9bb647d3-58f6-41cb-974c-ee709539a94a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.195183 Oct 04 03:31:19.409545 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 112/226] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:19 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:19.708999 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b8075d44-5379-42d5-a8a8-4374d70436f1 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:19.709500 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b8075d44-5379-42d5-a8a8-4374d70436f1 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:19.716878 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8075d44-5379-42d5-a8a8-4374d70436f1 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:19.717340 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8075d44-5379-42d5-a8a8-4374d70436f1 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:19.718107 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8075d44-5379-42d5-a8a8-4374d70436f1 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:19.719088 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8075d44-5379-42d5-a8a8-4374d70436f1 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:19.719713 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8075d44-5379-42d5-a8a8-4374d70436f1 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:19.720279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8075d44-5379-42d5-a8a8-4374d70436f1 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:19.748788 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b8075d44-5379-42d5-a8a8-4374d70436f1 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:31:19.850137 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b8075d44-5379-42d5-a8a8-4374d70436f1 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 204 len: 0 microversion: 2.1 time: 0.145176 Oct 04 03:31:19.851576 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 115/227] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:31:19 2022] DELETE /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:31:19.859581 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-06eb926d-d6f0-45a4-b217-e98bf23514a6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:19.860195 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-06eb926d-d6f0-45a4-b217-e98bf23514a6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:19.866605 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-06eb926d-d6f0-45a4-b217-e98bf23514a6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:19.867103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-06eb926d-d6f0-45a4-b217-e98bf23514a6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:19.867538 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-06eb926d-d6f0-45a4-b217-e98bf23514a6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:19.868237 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-06eb926d-d6f0-45a4-b217-e98bf23514a6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:19.868807 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-06eb926d-d6f0-45a4-b217-e98bf23514a6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:19.872493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-06eb926d-d6f0-45a4-b217-e98bf23514a6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:20.015063 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-06eb926d-d6f0-45a4-b217-e98bf23514a6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:20.016310 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ec25f81f-ce29-4812-b85a-f1a18511bedc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:20.016964 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ec25f81f-ce29-4812-b85a-f1a18511bedc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:20.024659 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ec25f81f-ce29-4812-b85a-f1a18511bedc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:20.025135 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ec25f81f-ce29-4812-b85a-f1a18511bedc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:20.025626 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ec25f81f-ce29-4812-b85a-f1a18511bedc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:20.026006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-06eb926d-d6f0-45a4-b217-e98bf23514a6 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 200 len: 1505 microversion: 2.1 time: 0.170337 Oct 04 03:31:20.026331 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ec25f81f-ce29-4812-b85a-f1a18511bedc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:20.026587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 113/228] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:19 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:20.028459 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ec25f81f-ce29-4812-b85a-f1a18511bedc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:20.028922 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ec25f81f-ce29-4812-b85a-f1a18511bedc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:20.054816 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ec25f81f-ce29-4812-b85a-f1a18511bedc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/ips" status: 200 len: 150 microversion: 2.20 time: 0.043474 Oct 04 03:31:20.055398 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 116/229] 10.222.0.25 () {60 vars in 1289 bytes} [Tue Oct 4 03:31:20 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:31:20.442797 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c33bfe53-b5dd-4d12-8522-c0cd27082c0f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:20.443704 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c33bfe53-b5dd-4d12-8522-c0cd27082c0f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:20.450106 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c33bfe53-b5dd-4d12-8522-c0cd27082c0f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:20.450703 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c33bfe53-b5dd-4d12-8522-c0cd27082c0f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:20.451008 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c33bfe53-b5dd-4d12-8522-c0cd27082c0f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:20.451739 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c33bfe53-b5dd-4d12-8522-c0cd27082c0f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:20.452220 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c33bfe53-b5dd-4d12-8522-c0cd27082c0f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:20.452813 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c33bfe53-b5dd-4d12-8522-c0cd27082c0f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:20.580103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c33bfe53-b5dd-4d12-8522-c0cd27082c0f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:20.587841 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c33bfe53-b5dd-4d12-8522-c0cd27082c0f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.149616 Oct 04 03:31:20.588398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 114/230] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:20 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:31:21.050672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-df76e2e3-49a9-4026-9693-fc47f3243eb2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:21.051410 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-df76e2e3-49a9-4026-9693-fc47f3243eb2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:21.058180 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-df76e2e3-49a9-4026-9693-fc47f3243eb2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:21.058651 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-df76e2e3-49a9-4026-9693-fc47f3243eb2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:21.059078 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-df76e2e3-49a9-4026-9693-fc47f3243eb2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:21.059789 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-df76e2e3-49a9-4026-9693-fc47f3243eb2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:21.060234 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-df76e2e3-49a9-4026-9693-fc47f3243eb2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:21.060647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-df76e2e3-49a9-4026-9693-fc47f3243eb2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:21.196031 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-df76e2e3-49a9-4026-9693-fc47f3243eb2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:21.205467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-df76e2e3-49a9-4026-9693-fc47f3243eb2 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 200 len: 1505 microversion: 2.1 time: 0.158563 Oct 04 03:31:21.206040 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 117/231] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:21 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:21.617008 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2d6a1b55-ba7e-4e0f-8905-7398c2016ca2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:21.617996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-2d6a1b55-ba7e-4e0f-8905-7398c2016ca2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:21.627255 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d6a1b55-ba7e-4e0f-8905-7398c2016ca2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:21.627781 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d6a1b55-ba7e-4e0f-8905-7398c2016ca2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:21.628220 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d6a1b55-ba7e-4e0f-8905-7398c2016ca2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:21.629893 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d6a1b55-ba7e-4e0f-8905-7398c2016ca2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:21.630357 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d6a1b55-ba7e-4e0f-8905-7398c2016ca2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:21.630773 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d6a1b55-ba7e-4e0f-8905-7398c2016ca2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:21.888764 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-2d6a1b55-ba7e-4e0f-8905-7398c2016ca2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:21.901513 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2d6a1b55-ba7e-4e0f-8905-7398c2016ca2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.294615 Oct 04 03:31:21.903301 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 115/232] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:21 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:22.230521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9e9f11e6-90a7-490d-9956-cfb42986f236 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:22.231178 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9e9f11e6-90a7-490d-9956-cfb42986f236 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:22.238880 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e9f11e6-90a7-490d-9956-cfb42986f236 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:22.239368 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e9f11e6-90a7-490d-9956-cfb42986f236 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:22.239826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e9f11e6-90a7-490d-9956-cfb42986f236 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:22.240527 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e9f11e6-90a7-490d-9956-cfb42986f236 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:22.245927 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e9f11e6-90a7-490d-9956-cfb42986f236 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:22.246522 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e9f11e6-90a7-490d-9956-cfb42986f236 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:22.270804 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-254f5bc9-d9b9-443e-ba66-91e563107620 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:22.271307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-254f5bc9-d9b9-443e-ba66-91e563107620 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:22.282407 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-254f5bc9-d9b9-443e-ba66-91e563107620 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:22.283138 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-254f5bc9-d9b9-443e-ba66-91e563107620 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:22.283970 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-254f5bc9-d9b9-443e-ba66-91e563107620 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:22.289604 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-254f5bc9-d9b9-443e-ba66-91e563107620 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:22.290331 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-254f5bc9-d9b9-443e-ba66-91e563107620 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:22.290984 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-254f5bc9-d9b9-443e-ba66-91e563107620 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:22.308736 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:22.328055 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-254f5bc9-d9b9-443e-ba66-91e563107620 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lazy-loading 'flavor' on Instance uuid f680f852-0ad9-4478-912f-1821b7755927 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:31:22.349087 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9e9f11e6-90a7-490d-9956-cfb42986f236 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b10acbb8324d1e98d17fbaf7ed732a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5424983f421548c3b6857a0e56aa08c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:22.360581 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9e9f11e6-90a7-490d-9956-cfb42986f236 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 200 len: 1463 microversion: 2.1 time: 0.134338 Oct 04 03:31:22.383814 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 118/233] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:22 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 1463 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:22.390830 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-b678a09d-9cb3-40ef-9c6a-fe0fba06dcd5 req-f2c7c13b-8d76-44dd-b1aa-defef7caa6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce8ceee-7136-4e9c-978f-41974b8c49df", "name": "network-vif-deleted", "tag": "7dc0cf11-878d-4709-b571-60406c4e5365"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:22.415181 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b678a09d-9cb3-40ef-9c6a-fe0fba06dcd5 req-f2c7c13b-8d76-44dd-b1aa-defef7caa6e2 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:22.416269 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b678a09d-9cb3-40ef-9c6a-fe0fba06dcd5 req-f2c7c13b-8d76-44dd-b1aa-defef7caa6e2 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:22.416976 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b678a09d-9cb3-40ef-9c6a-fe0fba06dcd5 req-f2c7c13b-8d76-44dd-b1aa-defef7caa6e2 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:22.431073 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-b678a09d-9cb3-40ef-9c6a-fe0fba06dcd5 req-f2c7c13b-8d76-44dd-b1aa-defef7caa6e2 service nova] Creating event network-vif-deleted:7dc0cf11-878d-4709-b571-60406c4e5365 for instance fce8ceee-7136-4e9c-978f-41974b8c49df on hv-cinder-84914 Oct 04 03:31:22.436865 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-b678a09d-9cb3-40ef-9c6a-fe0fba06dcd5 req-f2c7c13b-8d76-44dd-b1aa-defef7caa6e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051470 Oct 04 03:31:22.437787 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 119/234] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:31:22.601067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-254f5bc9-d9b9-443e-ba66-91e563107620 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "POST /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/action" status: 202 len: 0 microversion: 2.20 time: 0.333509 Oct 04 03:31:22.602898 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 116/235] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Oct 4 03:31:22 2022] POST /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 03:31:22.612612 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-37e378e5-99a8-4872-9dfb-94ececab7b5a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:22.613433 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-37e378e5-99a8-4872-9dfb-94ececab7b5a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:22.626710 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-37e378e5-99a8-4872-9dfb-94ececab7b5a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:22.627204 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-37e378e5-99a8-4872-9dfb-94ececab7b5a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:22.627670 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-37e378e5-99a8-4872-9dfb-94ececab7b5a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:22.628368 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-37e378e5-99a8-4872-9dfb-94ececab7b5a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:22.643704 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-37e378e5-99a8-4872-9dfb-94ececab7b5a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:22.644460 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-37e378e5-99a8-4872-9dfb-94ececab7b5a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:22.801924 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-37e378e5-99a8-4872-9dfb-94ececab7b5a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:22.813236 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-37e378e5-99a8-4872-9dfb-94ececab7b5a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:22.815248 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-37e378e5-99a8-4872-9dfb-94ececab7b5a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:22.816777 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-37e378e5-99a8-4872-9dfb-94ececab7b5a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.209633 Oct 04 03:31:22.817488 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 120/236] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:22 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:22.926477 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0dd722b0-2cfc-42b3-bd10-56a9693f7097 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:22.927173 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-0dd722b0-2cfc-42b3-bd10-56a9693f7097 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:22.936385 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0dd722b0-2cfc-42b3-bd10-56a9693f7097 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:22.936869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0dd722b0-2cfc-42b3-bd10-56a9693f7097 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:22.937301 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0dd722b0-2cfc-42b3-bd10-56a9693f7097 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:22.938048 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0dd722b0-2cfc-42b3-bd10-56a9693f7097 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:22.938443 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0dd722b0-2cfc-42b3-bd10-56a9693f7097 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:22.938884 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0dd722b0-2cfc-42b3-bd10-56a9693f7097 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:23.036659 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-35e4681d-023f-429e-9d61-bf02249edb2b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d14d8b0d-3c6d-4edc-ad90-b164f6028b5b"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:23.043813 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-35e4681d-023f-429e-9d61-bf02249edb2b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:23.047942 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35e4681d-023f-429e-9d61-bf02249edb2b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:23.048291 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35e4681d-023f-429e-9d61-bf02249edb2b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:23.048824 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35e4681d-023f-429e-9d61-bf02249edb2b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:23.049520 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35e4681d-023f-429e-9d61-bf02249edb2b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:23.049964 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35e4681d-023f-429e-9d61-bf02249edb2b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:23.050379 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35e4681d-023f-429e-9d61-bf02249edb2b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:23.088411 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0dd722b0-2cfc-42b3-bd10-56a9693f7097 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:23.104388 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0dd722b0-2cfc-42b3-bd10-56a9693f7097 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.181946 Oct 04 03:31:23.122038 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 117/237] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:22 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:31:23.341001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-35e4681d-023f-429e-9d61-bf02249edb2b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "POST /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308913 Oct 04 03:31:23.341770 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 121/238] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Oct 4 03:31:23 2022] POST /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:31:23.395317 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6d823319-7dec-4380-8b46-19832125f118 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:23.396053 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6d823319-7dec-4380-8b46-19832125f118 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] [instance: fce8ceee-7136-4e9c-978f-41974b8c49df] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:23.402457 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d823319-7dec-4380-8b46-19832125f118 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:23.402927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d823319-7dec-4380-8b46-19832125f118 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:23.403356 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d823319-7dec-4380-8b46-19832125f118 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:23.404094 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d823319-7dec-4380-8b46-19832125f118 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:23.404533 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d823319-7dec-4380-8b46-19832125f118 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:23.404951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d823319-7dec-4380-8b46-19832125f118 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:23.420911 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-6d823319-7dec-4380-8b46-19832125f118 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] HTTP exception thrown: Instance fce8ceee-7136-4e9c-978f-41974b8c49df could not be found. Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6d823319-7dec-4380-8b46-19832125f118 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Request method failure captured: Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df HTTP/1.1 Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6jp1QSPwCmeQZ9yQLj88xsPnOi0TWR0-RSAxuSgGnPqZZt6le_A9a2wLQ8dwFAm4CGWnwJpXABhSemXjPONShOpvgOr5sHAZf7QNlqP66mWKLKtGoxMuZPPhf-UkuOTfBiP_FQwFeASPKh_Y2SGCr61ZV-iaJXp5LpIFpfbYd7VeLU Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 5424983f421548c3b6857a0e56aa08c6 Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-VolumesActionsTest-1176679404 Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:31:23.422722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:31:23.424261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5424983f421548c3b6857a0e56aa08c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5424983f421548c3b6857a0e56aa08c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5424983f421548c3b6857a0e56aa08c6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5424983f421548c3b6857a0e56aa08c6"}]}] Oct 04 03:31:23.424261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-VolumesActionsTest-1176679404 Oct 04 03:31:23.424261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 5424983f421548c3b6857a0e56aa08c6 Oct 04 03:31:23.424261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-VolumesActionsTest-1176679404 Oct 04 03:31:23.424261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-VolumesActionsTest-1176679404-project Oct 04 03:31:23.424261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:31:23.424261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:31:23.424261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 72b10acbb8324d1e98d17fbaf7ed732a Oct 04 03:31:23.424261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-VolumesActionsTest-1176679404-project Oct 04 03:31:23.424261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:31:23.424261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance fce8ceee-7136-4e9c-978f-41974b8c49df could not be found. Oct 04 03:31:23.424261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': 'fce8ceee-7136-4e9c-978f-41974b8c49df'} Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce8ceee-7136-4e9c-978f-41974b8c49df could not be found. Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:31:23.425127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce8ceee-7136-4e9c-978f-41974b8c49df could not be found. Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce8ceee-7136-4e9c-978f-41974b8c49df could not be found. Oct 04 03:31:23.426474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:31:23.427606 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6d823319-7dec-4380-8b46-19832125f118 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] Returning 404 to user: Instance fce8ceee-7136-4e9c-978f-41974b8c49df could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:31:23.427606 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6d823319-7dec-4380-8b46-19832125f118 tempest-VolumesActionsTest-1176679404 tempest-VolumesActionsTest-1176679404-project] 10.222.0.25 "GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df" status: 404 len: 111 microversion: 2.1 time: 0.033212 Oct 04 03:31:23.427606 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 118/239] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:23 2022] GET /compute/v2.1/servers/fce8ceee-7136-4e9c-978f-41974b8c49df => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 03:31:23.848899 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e2165793-d2f3-47fa-a5b0-4b16bdb7795b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:23.849588 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e2165793-d2f3-47fa-a5b0-4b16bdb7795b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:23.856754 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2165793-d2f3-47fa-a5b0-4b16bdb7795b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:23.857327 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2165793-d2f3-47fa-a5b0-4b16bdb7795b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:23.857808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2165793-d2f3-47fa-a5b0-4b16bdb7795b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:23.858697 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2165793-d2f3-47fa-a5b0-4b16bdb7795b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:23.859185 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2165793-d2f3-47fa-a5b0-4b16bdb7795b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:23.859777 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2165793-d2f3-47fa-a5b0-4b16bdb7795b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:24.036774 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e2165793-d2f3-47fa-a5b0-4b16bdb7795b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:24.061430 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e2165793-d2f3-47fa-a5b0-4b16bdb7795b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:24.063180 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e2165793-d2f3-47fa-a5b0-4b16bdb7795b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:24.064755 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e2165793-d2f3-47fa-a5b0-4b16bdb7795b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.220581 Oct 04 03:31:24.065563 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 122/240] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:23 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:24.132378 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-016c8643-f329-4087-a9bb-a2faa8a65e63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:24.133300 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-016c8643-f329-4087-a9bb-a2faa8a65e63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:24.140590 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-016c8643-f329-4087-a9bb-a2faa8a65e63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:24.141073 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-016c8643-f329-4087-a9bb-a2faa8a65e63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:24.141730 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-016c8643-f329-4087-a9bb-a2faa8a65e63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:24.142720 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-016c8643-f329-4087-a9bb-a2faa8a65e63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:24.143174 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-016c8643-f329-4087-a9bb-a2faa8a65e63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:24.143824 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-016c8643-f329-4087-a9bb-a2faa8a65e63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:24.309005 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-016c8643-f329-4087-a9bb-a2faa8a65e63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:24.328257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-016c8643-f329-4087-a9bb-a2faa8a65e63 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.202371 Oct 04 03:31:24.331926 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 119/241] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:24 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:25.092329 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4f3ea6a0-db07-4845-8219-0b8c7129cfd8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:25.092942 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4f3ea6a0-db07-4845-8219-0b8c7129cfd8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:25.099384 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4f3ea6a0-db07-4845-8219-0b8c7129cfd8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:25.099903 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4f3ea6a0-db07-4845-8219-0b8c7129cfd8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:25.101002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4f3ea6a0-db07-4845-8219-0b8c7129cfd8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:25.101805 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4f3ea6a0-db07-4845-8219-0b8c7129cfd8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:25.102266 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4f3ea6a0-db07-4845-8219-0b8c7129cfd8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:25.102694 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4f3ea6a0-db07-4845-8219-0b8c7129cfd8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:25.253677 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-4f3ea6a0-db07-4845-8219-0b8c7129cfd8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:25.267358 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-4f3ea6a0-db07-4845-8219-0b8c7129cfd8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:25.269520 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-4f3ea6a0-db07-4845-8219-0b8c7129cfd8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:25.270872 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4f3ea6a0-db07-4845-8219-0b8c7129cfd8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.182773 Oct 04 03:31:25.271628 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 123/242] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:25 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:25.355922 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7d24daf8-4001-4522-abc6-24a6e0a23bc3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:25.357146 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-7d24daf8-4001-4522-abc6-24a6e0a23bc3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:25.363175 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7d24daf8-4001-4522-abc6-24a6e0a23bc3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:25.363853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7d24daf8-4001-4522-abc6-24a6e0a23bc3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:25.364439 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7d24daf8-4001-4522-abc6-24a6e0a23bc3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:25.365475 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7d24daf8-4001-4522-abc6-24a6e0a23bc3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:25.366795 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7d24daf8-4001-4522-abc6-24a6e0a23bc3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:25.367231 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7d24daf8-4001-4522-abc6-24a6e0a23bc3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:25.521433 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7d24daf8-4001-4522-abc6-24a6e0a23bc3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:25.530367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-7d24daf8-4001-4522-abc6-24a6e0a23bc3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.177413 Oct 04 03:31:25.531451 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 120/243] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:25 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:25.656637 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-010a2a5f-ee88-4fe7-80c8-6a697b7471e9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:25.665128 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-010a2a5f-ee88-4fe7-80c8-6a697b7471e9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:25.665858 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-010a2a5f-ee88-4fe7-80c8-6a697b7471e9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:25.666302 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-010a2a5f-ee88-4fe7-80c8-6a697b7471e9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:25.763901 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-010a2a5f-ee88-4fe7-80c8-6a697b7471e9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Going to try to stop instance {{(pid=120594) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 03:31:25.849851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-010a2a5f-ee88-4fe7-80c8-6a697b7471e9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "POST /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/action" status: 202 len: 0 microversion: 2.1 time: 0.196909 Oct 04 03:31:25.853066 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 124/244] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Oct 4 03:31:25 2022] POST /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:31:25.863003 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-8dc0df3f-94a3-4b74-9ebd-02aa21942d6e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:25.863921 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-8dc0df3f-94a3-4b74-9ebd-02aa21942d6e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:25.873163 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8dc0df3f-94a3-4b74-9ebd-02aa21942d6e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:25.873933 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8dc0df3f-94a3-4b74-9ebd-02aa21942d6e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:25.874580 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8dc0df3f-94a3-4b74-9ebd-02aa21942d6e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:25.875475 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8dc0df3f-94a3-4b74-9ebd-02aa21942d6e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:25.876087 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8dc0df3f-94a3-4b74-9ebd-02aa21942d6e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:25.876701 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8dc0df3f-94a3-4b74-9ebd-02aa21942d6e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:26.167834 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-8dc0df3f-94a3-4b74-9ebd-02aa21942d6e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:26.185516 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-8dc0df3f-94a3-4b74-9ebd-02aa21942d6e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.323467 Oct 04 03:31:26.186451 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 121/245] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:25 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:26.301923 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-af8a9568-6b7b-4299-81fe-5eaa6cf9471f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:26.303019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-af8a9568-6b7b-4299-81fe-5eaa6cf9471f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:26.312710 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af8a9568-6b7b-4299-81fe-5eaa6cf9471f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:26.313568 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af8a9568-6b7b-4299-81fe-5eaa6cf9471f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:26.314007 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af8a9568-6b7b-4299-81fe-5eaa6cf9471f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:26.314767 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af8a9568-6b7b-4299-81fe-5eaa6cf9471f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:26.315636 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af8a9568-6b7b-4299-81fe-5eaa6cf9471f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:26.316251 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af8a9568-6b7b-4299-81fe-5eaa6cf9471f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:26.348934 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:26.534783 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-af8a9568-6b7b-4299-81fe-5eaa6cf9471f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:26.545518 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-af8a9568-6b7b-4299-81fe-5eaa6cf9471f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:26.548080 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-af8a9568-6b7b-4299-81fe-5eaa6cf9471f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:26.549501 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-af8a9568-6b7b-4299-81fe-5eaa6cf9471f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.252075 Oct 04 03:31:26.550230 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 125/246] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:26 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:26.579107 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-33182927-da0b-479c-b400-181ff74590ed tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:26.579816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-33182927-da0b-479c-b400-181ff74590ed tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:26.587723 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33182927-da0b-479c-b400-181ff74590ed tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:26.588214 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33182927-da0b-479c-b400-181ff74590ed tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:26.588784 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33182927-da0b-479c-b400-181ff74590ed tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:26.589610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33182927-da0b-479c-b400-181ff74590ed tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:26.590407 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33182927-da0b-479c-b400-181ff74590ed tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:26.591127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33182927-da0b-479c-b400-181ff74590ed tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:26.670253 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e680e559-3216-44a1-aa65-44407d11efc7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:26.671276 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e680e559-3216-44a1-aa65-44407d11efc7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:26.683191 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e680e559-3216-44a1-aa65-44407d11efc7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:26.690522 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e680e559-3216-44a1-aa65-44407d11efc7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:26.691302 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e680e559-3216-44a1-aa65-44407d11efc7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:26.701658 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e680e559-3216-44a1-aa65-44407d11efc7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:26.702616 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e680e559-3216-44a1-aa65-44407d11efc7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:26.703525 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e680e559-3216-44a1-aa65-44407d11efc7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:26.736808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e680e559-3216-44a1-aa65-44407d11efc7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/ips" status: 200 len: 150 microversion: 2.1 time: 0.070334 Oct 04 03:31:26.737396 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 126/247] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Oct 4 03:31:26 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/ips => generated 150 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:31:26.847046 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-33182927-da0b-479c-b400-181ff74590ed tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:26.857147 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-33182927-da0b-479c-b400-181ff74590ed tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.306726 Oct 04 03:31:26.858233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 122/248] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:26 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:31:27.210831 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1318d5cb-3f81-405f-a54b-45389ff3ce10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:27.211457 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1318d5cb-3f81-405f-a54b-45389ff3ce10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:27.227771 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1318d5cb-3f81-405f-a54b-45389ff3ce10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:27.227771 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1318d5cb-3f81-405f-a54b-45389ff3ce10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:27.227771 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1318d5cb-3f81-405f-a54b-45389ff3ce10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:27.227771 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1318d5cb-3f81-405f-a54b-45389ff3ce10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:27.228084 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1318d5cb-3f81-405f-a54b-45389ff3ce10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:27.228084 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1318d5cb-3f81-405f-a54b-45389ff3ce10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:27.410677 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1318d5cb-3f81-405f-a54b-45389ff3ce10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:27.425514 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1318d5cb-3f81-405f-a54b-45389ff3ce10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.219136 Oct 04 03:31:27.440317 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 127/249] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:27 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:27.595294 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b8502f06-8d9e-4ce7-bd48-bb9a4affbbe4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:27.596667 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b8502f06-8d9e-4ce7-bd48-bb9a4affbbe4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:27.609900 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b8502f06-8d9e-4ce7-bd48-bb9a4affbbe4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:27.614753 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b8502f06-8d9e-4ce7-bd48-bb9a4affbbe4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:27.617552 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b8502f06-8d9e-4ce7-bd48-bb9a4affbbe4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:27.618549 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b8502f06-8d9e-4ce7-bd48-bb9a4affbbe4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:27.619209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b8502f06-8d9e-4ce7-bd48-bb9a4affbbe4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:27.619663 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b8502f06-8d9e-4ce7-bd48-bb9a4affbbe4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:27.829130 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b8502f06-8d9e-4ce7-bd48-bb9a4affbbe4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:27.839610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b8502f06-8d9e-4ce7-bd48-bb9a4affbbe4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:27.842273 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b8502f06-8d9e-4ce7-bd48-bb9a4affbbe4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:27.843905 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b8502f06-8d9e-4ce7-bd48-bb9a4affbbe4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.263432 Oct 04 03:31:27.845110 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 123/250] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:27 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:27.890934 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-522fbb7a-781e-4e2a-afc3-36135b6fc542 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:27.892011 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-522fbb7a-781e-4e2a-afc3-36135b6fc542 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:27.912516 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-522fbb7a-781e-4e2a-afc3-36135b6fc542 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:27.912516 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-522fbb7a-781e-4e2a-afc3-36135b6fc542 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:27.912516 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-522fbb7a-781e-4e2a-afc3-36135b6fc542 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:27.913470 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-522fbb7a-781e-4e2a-afc3-36135b6fc542 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:27.914182 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-522fbb7a-781e-4e2a-afc3-36135b6fc542 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:27.916842 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-522fbb7a-781e-4e2a-afc3-36135b6fc542 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:28.145533 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-522fbb7a-781e-4e2a-afc3-36135b6fc542 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:28.154056 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-522fbb7a-781e-4e2a-afc3-36135b6fc542 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.272716 Oct 04 03:31:28.155135 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 128/251] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:27 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:28.297651 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f468f07a-807e-4ca8-9156-d8094fd8c0a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e5e16c0-a230-4fcb-a42f-480299c760af"}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:28.300151 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f468f07a-807e-4ca8-9156-d8094fd8c0a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:28.306899 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f468f07a-807e-4ca8-9156-d8094fd8c0a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:28.307386 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f468f07a-807e-4ca8-9156-d8094fd8c0a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:28.307850 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f468f07a-807e-4ca8-9156-d8094fd8c0a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:28.308535 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f468f07a-807e-4ca8-9156-d8094fd8c0a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:28.308982 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f468f07a-807e-4ca8-9156-d8094fd8c0a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:28.309405 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f468f07a-807e-4ca8-9156-d8094fd8c0a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:28.461675 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8ab91c56-f409-46e9-93cb-c0755df92d08 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:28.467213 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8ab91c56-f409-46e9-93cb-c0755df92d08 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:28.484886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8ab91c56-f409-46e9-93cb-c0755df92d08 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:28.485389 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8ab91c56-f409-46e9-93cb-c0755df92d08 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:28.493268 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8ab91c56-f409-46e9-93cb-c0755df92d08 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:28.500604 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8ab91c56-f409-46e9-93cb-c0755df92d08 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:28.501552 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8ab91c56-f409-46e9-93cb-c0755df92d08 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:28.502154 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8ab91c56-f409-46e9-93cb-c0755df92d08 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:28.666539 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f468f07a-807e-4ca8-9156-d8094fd8c0a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "POST /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372432 Oct 04 03:31:28.667660 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 124/252] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Oct 4 03:31:28 2022] POST /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:31:28.671928 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-8ab91c56-f409-46e9-93cb-c0755df92d08 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:28.682239 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8ab91c56-f409-46e9-93cb-c0755df92d08 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.233467 Oct 04 03:31:28.683077 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 129/253] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:28 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:28.884155 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-cfbe89d8-d017-4185-8e6f-6fceaf2f950b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:28.885495 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-cfbe89d8-d017-4185-8e6f-6fceaf2f950b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:28.895681 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cfbe89d8-d017-4185-8e6f-6fceaf2f950b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:28.897093 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cfbe89d8-d017-4185-8e6f-6fceaf2f950b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:28.898785 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cfbe89d8-d017-4185-8e6f-6fceaf2f950b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:28.899933 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cfbe89d8-d017-4185-8e6f-6fceaf2f950b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:28.900952 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cfbe89d8-d017-4185-8e6f-6fceaf2f950b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:28.901708 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cfbe89d8-d017-4185-8e6f-6fceaf2f950b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:29.067875 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-cfbe89d8-d017-4185-8e6f-6fceaf2f950b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:29.084435 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-cfbe89d8-d017-4185-8e6f-6fceaf2f950b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:29.088042 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-cfbe89d8-d017-4185-8e6f-6fceaf2f950b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:29.090195 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-cfbe89d8-d017-4185-8e6f-6fceaf2f950b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.218951 Oct 04 03:31:29.091583 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 125/254] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:28 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:29.184960 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-68cf5d49-b7fc-4986-9ac8-656e08026d88 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:29.188144 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-68cf5d49-b7fc-4986-9ac8-656e08026d88 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:29.207990 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-68cf5d49-b7fc-4986-9ac8-656e08026d88 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:29.209121 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-68cf5d49-b7fc-4986-9ac8-656e08026d88 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:29.209732 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-68cf5d49-b7fc-4986-9ac8-656e08026d88 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:29.211170 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-68cf5d49-b7fc-4986-9ac8-656e08026d88 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:29.212227 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-68cf5d49-b7fc-4986-9ac8-656e08026d88 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:29.212760 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-68cf5d49-b7fc-4986-9ac8-656e08026d88 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:29.647321 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-68cf5d49-b7fc-4986-9ac8-656e08026d88 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:29.657374 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-68cf5d49-b7fc-4986-9ac8-656e08026d88 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.482801 Oct 04 03:31:29.658551 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 130/255] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:29 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:29.728476 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d230c144-4252-41cd-a5ec-8e31870c19fe tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:29.730290 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d230c144-4252-41cd-a5ec-8e31870c19fe tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:29.740095 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d230c144-4252-41cd-a5ec-8e31870c19fe tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:29.747419 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d230c144-4252-41cd-a5ec-8e31870c19fe tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:29.748059 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d230c144-4252-41cd-a5ec-8e31870c19fe tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:29.749124 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d230c144-4252-41cd-a5ec-8e31870c19fe tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:29.751232 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d230c144-4252-41cd-a5ec-8e31870c19fe tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:29.753116 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d230c144-4252-41cd-a5ec-8e31870c19fe tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:29.933662 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d230c144-4252-41cd-a5ec-8e31870c19fe tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:29.941988 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d230c144-4252-41cd-a5ec-8e31870c19fe tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.231236 Oct 04 03:31:29.955844 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 126/256] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:29 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:30.122613 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8602b66c-a415-4601-9149-c85a6c038e74 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:30.123763 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8602b66c-a415-4601-9149-c85a6c038e74 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:30.144187 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8602b66c-a415-4601-9149-c85a6c038e74 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:30.144789 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8602b66c-a415-4601-9149-c85a6c038e74 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:30.153502 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8602b66c-a415-4601-9149-c85a6c038e74 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:30.154724 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8602b66c-a415-4601-9149-c85a6c038e74 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:30.156115 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8602b66c-a415-4601-9149-c85a6c038e74 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:30.156542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8602b66c-a415-4601-9149-c85a6c038e74 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:30.361823 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-8602b66c-a415-4601-9149-c85a6c038e74 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:30.371172 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-8602b66c-a415-4601-9149-c85a6c038e74 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:30.372791 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-8602b66c-a415-4601-9149-c85a6c038e74 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:30.374062 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8602b66c-a415-4601-9149-c85a6c038e74 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.256768 Oct 04 03:31:30.374809 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 131/257] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:30 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:30.687848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-bbd7df6d-f82f-4118-b694-aff6c50c7e72 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:30.688740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-bbd7df6d-f82f-4118-b694-aff6c50c7e72 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:30.697842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bbd7df6d-f82f-4118-b694-aff6c50c7e72 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:30.698340 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bbd7df6d-f82f-4118-b694-aff6c50c7e72 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:30.698779 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bbd7df6d-f82f-4118-b694-aff6c50c7e72 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:30.699517 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bbd7df6d-f82f-4118-b694-aff6c50c7e72 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:30.700128 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bbd7df6d-f82f-4118-b694-aff6c50c7e72 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:30.700706 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bbd7df6d-f82f-4118-b694-aff6c50c7e72 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:30.886585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-bbd7df6d-f82f-4118-b694-aff6c50c7e72 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:30.898950 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-bbd7df6d-f82f-4118-b694-aff6c50c7e72 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.216219 Oct 04 03:31:30.901266 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 127/258] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:30 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:30.967751 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f9ea0ff1-1edd-45e8-b3fe-e87685fcba53 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:30.968355 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f9ea0ff1-1edd-45e8-b3fe-e87685fcba53 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:30.983392 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f9ea0ff1-1edd-45e8-b3fe-e87685fcba53 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:30.985416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f9ea0ff1-1edd-45e8-b3fe-e87685fcba53 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:30.986225 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f9ea0ff1-1edd-45e8-b3fe-e87685fcba53 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:30.987103 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f9ea0ff1-1edd-45e8-b3fe-e87685fcba53 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:30.987736 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f9ea0ff1-1edd-45e8-b3fe-e87685fcba53 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:30.988318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f9ea0ff1-1edd-45e8-b3fe-e87685fcba53 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:31.071719 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7f597b70-fa36-439a-a63f-d36ae59ea007 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Action: 'create', calling method: .version_select at 0x7f165b722b80>, body: {"keypair": {"name": "tempest-keypair-1341174055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPKSDrRKQ1t8bv5LFZHpR6tDz3cNMHQhe4d3pyXCkk5tEzxzr/NJjm5isF4Me0W7YesvCsiLalAgmDCfEbJw31xR6inmzgJ4+s/h/g3HySVZ8tZbq3GrT0qJbgaaEVLzg=="}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:31.109144 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-7f597b70-fa36-439a-a63f-d36ae59ea007 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'key_pairs'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:31:31.117868 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-7f597b70-fa36-439a-a63f-d36ae59ea007 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for user b8795829c34046628cae345dd4d45e75 and project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'key_pairs'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:31:31.183525 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-7f597b70-fa36-439a-a63f-d36ae59ea007 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118631 Oct 04 03:31:31.186116 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 128/259] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Oct 4 03:31:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:31:31.400863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f956a44f-f389-4acf-aac1-348e9e6ca371 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:31.401481 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f956a44f-f389-4acf-aac1-348e9e6ca371 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:31.417514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f956a44f-f389-4acf-aac1-348e9e6ca371 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:31.418024 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f956a44f-f389-4acf-aac1-348e9e6ca371 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:31.418456 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f956a44f-f389-4acf-aac1-348e9e6ca371 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:31.425931 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f956a44f-f389-4acf-aac1-348e9e6ca371 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:31.426425 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f956a44f-f389-4acf-aac1-348e9e6ca371 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:31.426902 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f956a44f-f389-4acf-aac1-348e9e6ca371 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:31.519216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f9ea0ff1-1edd-45e8-b3fe-e87685fcba53 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:31.530459 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f9ea0ff1-1edd-45e8-b3fe-e87685fcba53 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.566364 Oct 04 03:31:31.547793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 132/260] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:30 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:31.666188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f956a44f-f389-4acf-aac1-348e9e6ca371 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:31.681104 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f956a44f-f389-4acf-aac1-348e9e6ca371 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:31.684403 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f956a44f-f389-4acf-aac1-348e9e6ca371 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:31.687135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f956a44f-f389-4acf-aac1-348e9e6ca371 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.291204 Oct 04 03:31:31.688602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 129/261] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:31 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:31:31.929854 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-99940f3b-b74e-42f3-9269-29fe754feaad tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:31.930480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-99940f3b-b74e-42f3-9269-29fe754feaad tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:31.948226 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99940f3b-b74e-42f3-9269-29fe754feaad tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:31.948726 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99940f3b-b74e-42f3-9269-29fe754feaad tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:31.949165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99940f3b-b74e-42f3-9269-29fe754feaad tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:31.949980 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99940f3b-b74e-42f3-9269-29fe754feaad tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:31.950464 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99940f3b-b74e-42f3-9269-29fe754feaad tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:31.950912 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99940f3b-b74e-42f3-9269-29fe754feaad tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:32.186890 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-99940f3b-b74e-42f3-9269-29fe754feaad tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:32.199298 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-99940f3b-b74e-42f3-9269-29fe754feaad tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.273731 Oct 04 03:31:32.199923 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 133/262] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:31 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:32.559300 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-63145052-3f65-40d6-a4b1-f016a98f3f89 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:32.560172 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-63145052-3f65-40d6-a4b1-f016a98f3f89 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:32.573670 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-63145052-3f65-40d6-a4b1-f016a98f3f89 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:32.574592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-63145052-3f65-40d6-a4b1-f016a98f3f89 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:32.576011 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-63145052-3f65-40d6-a4b1-f016a98f3f89 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:32.577005 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-63145052-3f65-40d6-a4b1-f016a98f3f89 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:32.577670 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-63145052-3f65-40d6-a4b1-f016a98f3f89 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:32.578987 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-63145052-3f65-40d6-a4b1-f016a98f3f89 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:32.716475 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-eda7fa76-692f-4c69-bfc4-388b426f7b38 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:32.717260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-eda7fa76-692f-4c69-bfc4-388b426f7b38 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:32.727561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eda7fa76-692f-4c69-bfc4-388b426f7b38 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:32.729018 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eda7fa76-692f-4c69-bfc4-388b426f7b38 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:32.731794 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eda7fa76-692f-4c69-bfc4-388b426f7b38 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:32.732695 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eda7fa76-692f-4c69-bfc4-388b426f7b38 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:32.734948 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eda7fa76-692f-4c69-bfc4-388b426f7b38 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:32.735761 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eda7fa76-692f-4c69-bfc4-388b426f7b38 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:32.927043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-63145052-3f65-40d6-a4b1-f016a98f3f89 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:32.946519 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-63145052-3f65-40d6-a4b1-f016a98f3f89 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.394554 Oct 04 03:31:32.948030 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 130/263] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:32 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:33.081191 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-eda7fa76-692f-4c69-bfc4-388b426f7b38 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:33.094545 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-eda7fa76-692f-4c69-bfc4-388b426f7b38 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:33.096017 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-eda7fa76-692f-4c69-bfc4-388b426f7b38 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:33.103097 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-eda7fa76-692f-4c69-bfc4-388b426f7b38 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.392234 Oct 04 03:31:33.103714 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 134/264] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:32 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:33.229307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6d52d194-ff29-4ec9-b998-e5e78b71cc49 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:33.232036 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6d52d194-ff29-4ec9-b998-e5e78b71cc49 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:33.242452 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d52d194-ff29-4ec9-b998-e5e78b71cc49 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:33.244329 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d52d194-ff29-4ec9-b998-e5e78b71cc49 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:33.245790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d52d194-ff29-4ec9-b998-e5e78b71cc49 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:33.247343 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d52d194-ff29-4ec9-b998-e5e78b71cc49 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:33.250105 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d52d194-ff29-4ec9-b998-e5e78b71cc49 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:33.250602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d52d194-ff29-4ec9-b998-e5e78b71cc49 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:33.287779 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:33.595921 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6d52d194-ff29-4ec9-b998-e5e78b71cc49 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:33.604399 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6d52d194-ff29-4ec9-b998-e5e78b71cc49 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.380349 Oct 04 03:31:33.620116 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 131/265] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:33 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:33.711409 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-259249913", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "86d4958b-fe69-4a74-b4b0-c186c2f360dd"}], "security_groups": [{"name": "tempest-securitygroup--1774040404"}], "key_name": "tempest-keypair-1341174055", "user_data": "}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:33.900716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] validate_networks() for [('86d4958b-fe69-4a74-b4b0-c186c2f360dd', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:31:33.977687 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b6963439-280d-4acc-87af-5fd4b9441d94 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:33.980592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b6963439-280d-4acc-87af-5fd4b9441d94 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:34.038163 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b6963439-280d-4acc-87af-5fd4b9441d94 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:34.040288 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b6963439-280d-4acc-87af-5fd4b9441d94 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:34.040739 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b6963439-280d-4acc-87af-5fd4b9441d94 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:34.041461 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b6963439-280d-4acc-87af-5fd4b9441d94 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:34.041915 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b6963439-280d-4acc-87af-5fd4b9441d94 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:34.042336 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b6963439-280d-4acc-87af-5fd4b9441d94 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:34.343316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b6963439-280d-4acc-87af-5fd4b9441d94 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:34.343316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b6963439-280d-4acc-87af-5fd4b9441d94 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.364134 Oct 04 03:31:34.343316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 132/266] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:33 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:34.343316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-1271d4f4-3f16-4534-8761-52d1c6094588 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:34.344174 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-1271d4f4-3f16-4534-8761-52d1c6094588 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:34.349402 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1271d4f4-3f16-4534-8761-52d1c6094588 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:34.350134 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1271d4f4-3f16-4534-8761-52d1c6094588 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:34.351439 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1271d4f4-3f16-4534-8761-52d1c6094588 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:34.352760 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1271d4f4-3f16-4534-8761-52d1c6094588 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:34.353360 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1271d4f4-3f16-4534-8761-52d1c6094588 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:34.354000 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1271d4f4-3f16-4534-8761-52d1c6094588 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:34.928904 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-1271d4f4-3f16-4534-8761-52d1c6094588 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:34.938789 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-1271d4f4-3f16-4534-8761-52d1c6094588 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:34.951881 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-1271d4f4-3f16-4534-8761-52d1c6094588 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:34.953372 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-1271d4f4-3f16-4534-8761-52d1c6094588 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.616645 Oct 04 03:31:34.954465 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 133/267] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:34 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:34.959319 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-75d213b5-868f-431d-b3cf-ab390aaa959d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:34.964505 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-75d213b5-868f-431d-b3cf-ab390aaa959d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:34.972788 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-75d213b5-868f-431d-b3cf-ab390aaa959d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:34.980236 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-75d213b5-868f-431d-b3cf-ab390aaa959d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:34.980683 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-75d213b5-868f-431d-b3cf-ab390aaa959d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:34.981419 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-75d213b5-868f-431d-b3cf-ab390aaa959d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:34.981874 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-75d213b5-868f-431d-b3cf-ab390aaa959d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:34.982465 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-75d213b5-868f-431d-b3cf-ab390aaa959d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:35.336146 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:31:35.336710 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:31:35.337137 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:31:35.337938 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:31:35.338593 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:31:35.360251 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:35.365465 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:35.366406 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:35.373975 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:35.375181 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:35.375797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:35.385953 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-75d213b5-868f-431d-b3cf-ab390aaa959d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:35.398029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-75d213b5-868f-431d-b3cf-ab390aaa959d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.441783 Oct 04 03:31:35.411865 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 134/268] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:34 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:35.420639 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:31:35.420849 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-661424bc-ed7c-45a3-bf44-c000e62332d6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:35.426245 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-661424bc-ed7c-45a3-bf44-c000e62332d6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:35.429253 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for user b8795829c34046628cae345dd4d45e75 and project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:31:35.434121 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:35.438454 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-661424bc-ed7c-45a3-bf44-c000e62332d6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:35.439298 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-661424bc-ed7c-45a3-bf44-c000e62332d6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:35.440393 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-661424bc-ed7c-45a3-bf44-c000e62332d6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:35.441752 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-661424bc-ed7c-45a3-bf44-c000e62332d6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:35.442463 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-661424bc-ed7c-45a3-bf44-c000e62332d6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:35.444509 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-661424bc-ed7c-45a3-bf44-c000e62332d6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:35.445853 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:31:35.449922 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:31:35.571924 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0e72939c-e4d4-46c8-a078-7468ddb3135f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.842787 Oct 04 03:31:35.573689 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 135/269] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:31:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 03:31:35.593981 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2e6bcbd7-ec31-47dc-a1ae-6d72a721f32b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:35.594779 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2e6bcbd7-ec31-47dc-a1ae-6d72a721f32b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:35.849617 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2e6bcbd7-ec31-47dc-a1ae-6d72a721f32b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:35.862243 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2e6bcbd7-ec31-47dc-a1ae-6d72a721f32b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1241 microversion: 2.1 time: 0.279183 Oct 04 03:31:35.887688 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 136/270] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:35 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1241 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:35.984818 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6b588f33-c70e-4d73-b6df-fe17d5295cd1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:35.986245 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6b588f33-c70e-4d73-b6df-fe17d5295cd1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:36.001266 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b588f33-c70e-4d73-b6df-fe17d5295cd1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:36.003217 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b588f33-c70e-4d73-b6df-fe17d5295cd1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:36.004691 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b588f33-c70e-4d73-b6df-fe17d5295cd1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:36.007667 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b588f33-c70e-4d73-b6df-fe17d5295cd1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:36.008431 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b588f33-c70e-4d73-b6df-fe17d5295cd1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:36.010394 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b588f33-c70e-4d73-b6df-fe17d5295cd1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:36.314333 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-661424bc-ed7c-45a3-bf44-c000e62332d6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:36.327809 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-661424bc-ed7c-45a3-bf44-c000e62332d6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.925574 Oct 04 03:31:36.332958 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 135/271] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:35 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:36.421685 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6b588f33-c70e-4d73-b6df-fe17d5295cd1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:36.433623 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b46a231c-e87c-45d8-bed9-6004a8a6399a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:36.434124 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6b588f33-c70e-4d73-b6df-fe17d5295cd1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:36.434249 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b46a231c-e87c-45d8-bed9-6004a8a6399a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:36.436247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6b588f33-c70e-4d73-b6df-fe17d5295cd1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:36.438231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6b588f33-c70e-4d73-b6df-fe17d5295cd1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.458529 Oct 04 03:31:36.439308 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 137/272] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:35 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:36.455823 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b46a231c-e87c-45d8-bed9-6004a8a6399a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:36.456339 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b46a231c-e87c-45d8-bed9-6004a8a6399a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:36.456776 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b46a231c-e87c-45d8-bed9-6004a8a6399a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:36.459448 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b46a231c-e87c-45d8-bed9-6004a8a6399a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:36.459977 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b46a231c-e87c-45d8-bed9-6004a8a6399a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:36.460414 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b46a231c-e87c-45d8-bed9-6004a8a6399a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:36.886105 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b46a231c-e87c-45d8-bed9-6004a8a6399a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:36.887799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cda943ff-f2d0-4a2a-89e5-0774d00d17bc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:36.888547 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cda943ff-f2d0-4a2a-89e5-0774d00d17bc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:36.900793 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b46a231c-e87c-45d8-bed9-6004a8a6399a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1502 microversion: 2.1 time: 0.480383 Oct 04 03:31:36.919619 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 136/273] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:36 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1502 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:31:36.919733 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cda943ff-f2d0-4a2a-89e5-0774d00d17bc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:36.919733 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cda943ff-f2d0-4a2a-89e5-0774d00d17bc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:36.919733 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cda943ff-f2d0-4a2a-89e5-0774d00d17bc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:36.919733 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cda943ff-f2d0-4a2a-89e5-0774d00d17bc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:36.920146 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cda943ff-f2d0-4a2a-89e5-0774d00d17bc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:36.920146 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cda943ff-f2d0-4a2a-89e5-0774d00d17bc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:36.929109 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-57dc4dc8-bccc-40c6-b11f-a91ccb16a913 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97c8c9da-38e0-4f79-999f-137eeab09f95"}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:36.932523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-57dc4dc8-bccc-40c6-b11f-a91ccb16a913 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:36.972828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-57dc4dc8-bccc-40c6-b11f-a91ccb16a913 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:36.973427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-57dc4dc8-bccc-40c6-b11f-a91ccb16a913 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:36.975528 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-57dc4dc8-bccc-40c6-b11f-a91ccb16a913 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:36.976483 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-57dc4dc8-bccc-40c6-b11f-a91ccb16a913 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:36.977122 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-57dc4dc8-bccc-40c6-b11f-a91ccb16a913 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:36.979904 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-57dc4dc8-bccc-40c6-b11f-a91ccb16a913 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:37.055351 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-57dc4dc8-bccc-40c6-b11f-a91ccb16a913 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] HTTP exception thrown: Cannot 'attach_volume' instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e while it is in vm_state rescued Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-57dc4dc8-bccc-40c6-b11f-a91ccb16a913 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Request method failure captured: Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: POST /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e/os-volume_attachments HTTP/1.1 Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 74 Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6iuldyrIBbW0f73v2K7ATYrextCGz2-_Yc58_h0cv-5TQFrImJgI3vgI3ryyGo9OGTifdm0w3ZapIKJj0Fj0su00BfHCMYaElTS2T4ES-IzJv9KifpjH3rp-cobaqB4aXjivbFQVaV2D5PTfUOLh5YQ34ZK3qeegc9sqNgzArwYGQ4 Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: b62fd4925f3840edb9806630cd78c9fa Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:31:37.058258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:31:37.060358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b62fd4925f3840edb9806630cd78c9fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b62fd4925f3840edb9806630cd78c9fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b62fd4925f3840edb9806630cd78c9fa", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b62fd4925f3840edb9806630cd78c9fa"}]}] Oct 04 03:31:37.060358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:31:37.060358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: b62fd4925f3840edb9806630cd78c9fa Oct 04 03:31:37.060358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:31:37.060358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-ServerRescueNegativeTestJSON-465130473-project Oct 04 03:31:37.060358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:31:37.060358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:31:37.060358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: a267cf7109c64f538824c162fedd084b Oct 04 03:31:37.060358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-465130473-project Oct 04 03:31:37.060358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Oct 04 03:31:37.060358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {"volumeAttachment": {"volumeId": "97c8c9da-38e0-4f79-999f-137eeab09f95"}} Oct 04 03:31:37.060358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Cannot 'attach_volume' instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e while it is in vm_state rescued Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'server_id': '05277cf6-48c9-4eba-ae7a-4c7023431f1e', 'body': {'volumeAttachment': {'volumeId': '97c8c9da-38e0-4f79-999f-137eeab09f95'}}} Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:31:37.061630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e while it is in vm_state rescued Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:31:37.063367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:31:37.065449 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:31:37.065449 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:31:37.065449 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e while it is in vm_state rescued Oct 04 03:31:37.065449 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:31:37.071096 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-57dc4dc8-bccc-40c6-b11f-a91ccb16a913 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Returning 409 to user: Cannot 'attach_volume' instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e while it is in vm_state rescued {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:31:37.072192 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-57dc4dc8-bccc-40c6-b11f-a91ccb16a913 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "POST /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.150992 Oct 04 03:31:37.075122 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 137/274] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Oct 4 03:31:36 2022] POST /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e/os-volume_attachments => generated 152 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 03:31:37.092686 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-22c9c2cd-5790-40a6-ad0f-7640b995889b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:37.094778 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-22c9c2cd-5790-40a6-ad0f-7640b995889b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:37.113473 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-22c9c2cd-5790-40a6-ad0f-7640b995889b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:37.113911 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-cda943ff-f2d0-4a2a-89e5-0774d00d17bc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:37.115057 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-22c9c2cd-5790-40a6-ad0f-7640b995889b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:37.116196 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-22c9c2cd-5790-40a6-ad0f-7640b995889b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:37.117310 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-22c9c2cd-5790-40a6-ad0f-7640b995889b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:37.117961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-22c9c2cd-5790-40a6-ad0f-7640b995889b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:37.118508 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-22c9c2cd-5790-40a6-ad0f-7640b995889b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:37.137962 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cda943ff-f2d0-4a2a-89e5-0774d00d17bc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1293 microversion: 2.1 time: 0.255279 Oct 04 03:31:37.142850 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 138/275] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:36 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1293 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:37.235894 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-22c9c2cd-5790-40a6-ad0f-7640b995889b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "POST /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e/action" status: 202 len: 0 microversion: 2.1 time: 0.146690 Oct 04 03:31:37.239901 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 138/276] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Oct 4 03:31:37 2022] POST /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:31:37.245423 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-be70be62-5449-42f2-bb8c-e683cfb55904 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:37.246030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-be70be62-5449-42f2-bb8c-e683cfb55904 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:37.254639 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-be70be62-5449-42f2-bb8c-e683cfb55904 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:37.255288 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-be70be62-5449-42f2-bb8c-e683cfb55904 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:37.255910 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-be70be62-5449-42f2-bb8c-e683cfb55904 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:37.257246 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-be70be62-5449-42f2-bb8c-e683cfb55904 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:37.257474 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-be70be62-5449-42f2-bb8c-e683cfb55904 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:37.257894 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-be70be62-5449-42f2-bb8c-e683cfb55904 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:37.363149 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e9461201-3a8d-4cf8-88fe-934a363a8b84 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:37.363955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e9461201-3a8d-4cf8-88fe-934a363a8b84 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:37.370344 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e9461201-3a8d-4cf8-88fe-934a363a8b84 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:37.371106 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e9461201-3a8d-4cf8-88fe-934a363a8b84 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:37.371818 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e9461201-3a8d-4cf8-88fe-934a363a8b84 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:37.372720 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e9461201-3a8d-4cf8-88fe-934a363a8b84 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:37.373394 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e9461201-3a8d-4cf8-88fe-934a363a8b84 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:37.374061 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e9461201-3a8d-4cf8-88fe-934a363a8b84 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:37.499072 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-be70be62-5449-42f2-bb8c-e683cfb55904 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:37.508075 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-be70be62-5449-42f2-bb8c-e683cfb55904 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1510 microversion: 2.1 time: 0.266752 Oct 04 03:31:37.517701 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 139/277] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:37 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1510 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:31:37.523350 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e2b3122e-1550-4c27-bda4-e5ee5f845da4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:37.524212 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e2b3122e-1550-4c27-bda4-e5ee5f845da4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:37.532471 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2b3122e-1550-4c27-bda4-e5ee5f845da4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:37.533219 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2b3122e-1550-4c27-bda4-e5ee5f845da4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:37.533927 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2b3122e-1550-4c27-bda4-e5ee5f845da4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:37.534846 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2b3122e-1550-4c27-bda4-e5ee5f845da4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:37.543547 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2b3122e-1550-4c27-bda4-e5ee5f845da4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:37.546569 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2b3122e-1550-4c27-bda4-e5ee5f845da4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:37.622958 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e9461201-3a8d-4cf8-88fe-934a363a8b84 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:37.643158 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e9461201-3a8d-4cf8-88fe-934a363a8b84 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.285817 Oct 04 03:31:37.644344 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 139/278] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:37 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:37.839350 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e2b3122e-1550-4c27-bda4-e5ee5f845da4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:37.862011 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e2b3122e-1550-4c27-bda4-e5ee5f845da4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:37.864134 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e2b3122e-1550-4c27-bda4-e5ee5f845da4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:37.866129 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e2b3122e-1550-4c27-bda4-e5ee5f845da4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.346652 Oct 04 03:31:37.867069 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 140/279] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:37 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:38.169368 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e4ab717d-7331-4cad-a3d4-730d0fd5a2e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:38.170036 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e4ab717d-7331-4cad-a3d4-730d0fd5a2e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:38.182293 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4ab717d-7331-4cad-a3d4-730d0fd5a2e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:38.183168 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4ab717d-7331-4cad-a3d4-730d0fd5a2e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:38.184164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4ab717d-7331-4cad-a3d4-730d0fd5a2e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:38.185032 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4ab717d-7331-4cad-a3d4-730d0fd5a2e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:38.185669 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4ab717d-7331-4cad-a3d4-730d0fd5a2e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:38.186248 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4ab717d-7331-4cad-a3d4-730d0fd5a2e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:38.424129 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e4ab717d-7331-4cad-a3d4-730d0fd5a2e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:38.444404 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e4ab717d-7331-4cad-a3d4-730d0fd5a2e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1311 microversion: 2.1 time: 0.280612 Oct 04 03:31:38.445531 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 140/280] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:38 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1311 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:38.547768 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3dc2239b-1c3d-4de3-ac80-7e81d149b3d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:38.548414 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3dc2239b-1c3d-4de3-ac80-7e81d149b3d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:38.559467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dc2239b-1c3d-4de3-ac80-7e81d149b3d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:38.559990 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dc2239b-1c3d-4de3-ac80-7e81d149b3d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:38.560423 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dc2239b-1c3d-4de3-ac80-7e81d149b3d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:38.561184 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dc2239b-1c3d-4de3-ac80-7e81d149b3d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:38.561709 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dc2239b-1c3d-4de3-ac80-7e81d149b3d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:38.562136 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dc2239b-1c3d-4de3-ac80-7e81d149b3d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:38.672523 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d0a2b9ac-471f-46fd-9670-45bd4b2db309 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:38.673173 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d0a2b9ac-471f-46fd-9670-45bd4b2db309 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:38.681769 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d0a2b9ac-471f-46fd-9670-45bd4b2db309 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:38.682207 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d0a2b9ac-471f-46fd-9670-45bd4b2db309 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:38.682723 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d0a2b9ac-471f-46fd-9670-45bd4b2db309 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:38.683480 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d0a2b9ac-471f-46fd-9670-45bd4b2db309 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:38.693602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d0a2b9ac-471f-46fd-9670-45bd4b2db309 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:38.694612 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d0a2b9ac-471f-46fd-9670-45bd4b2db309 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:38.855567 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-3dc2239b-1c3d-4de3-ac80-7e81d149b3d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:38.866219 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3dc2239b-1c3d-4de3-ac80-7e81d149b3d3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1510 microversion: 2.1 time: 0.321925 Oct 04 03:31:38.867032 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 141/281] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:38 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:38.892712 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d0a2b9ac-471f-46fd-9670-45bd4b2db309 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:38.926632 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a219e772-0413-42d6-a1f6-d7c0de9b9c92 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:38.927819 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d0a2b9ac-471f-46fd-9670-45bd4b2db309 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.256913 Oct 04 03:31:38.946105 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a219e772-0413-42d6-a1f6-d7c0de9b9c92 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:38.952111 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 141/282] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:38 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:31:38.960223 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a219e772-0413-42d6-a1f6-d7c0de9b9c92 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:38.961105 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a219e772-0413-42d6-a1f6-d7c0de9b9c92 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:38.961743 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a219e772-0413-42d6-a1f6-d7c0de9b9c92 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:38.962671 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a219e772-0413-42d6-a1f6-d7c0de9b9c92 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:38.964383 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a219e772-0413-42d6-a1f6-d7c0de9b9c92 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:38.964926 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a219e772-0413-42d6-a1f6-d7c0de9b9c92 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:39.468866 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6a15f3e7-ec22-4cb7-88c6-9ad148b551d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:39.469508 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6a15f3e7-ec22-4cb7-88c6-9ad148b551d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:39.477098 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a219e772-0413-42d6-a1f6-d7c0de9b9c92 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:39.481495 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6a15f3e7-ec22-4cb7-88c6-9ad148b551d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:39.484109 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6a15f3e7-ec22-4cb7-88c6-9ad148b551d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:39.485587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6a15f3e7-ec22-4cb7-88c6-9ad148b551d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:39.493320 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a219e772-0413-42d6-a1f6-d7c0de9b9c92 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:39.494180 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6a15f3e7-ec22-4cb7-88c6-9ad148b551d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:39.494783 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a219e772-0413-42d6-a1f6-d7c0de9b9c92 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:39.495830 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6a15f3e7-ec22-4cb7-88c6-9ad148b551d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:39.496007 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a219e772-0413-42d6-a1f6-d7c0de9b9c92 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.588261 Oct 04 03:31:39.496558 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 142/283] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:38 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:39.496812 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6a15f3e7-ec22-4cb7-88c6-9ad148b551d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:39.618187 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6a15f3e7-ec22-4cb7-88c6-9ad148b551d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:39.632760 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6a15f3e7-ec22-4cb7-88c6-9ad148b551d3 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1299 microversion: 2.1 time: 0.166331 Oct 04 03:31:39.633660 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 142/284] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:39 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:31:39.894514 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-28ff4773-4cce-4ec9-a1fd-9c814df56c54 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:39.895296 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-28ff4773-4cce-4ec9-a1fd-9c814df56c54 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:39.910233 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28ff4773-4cce-4ec9-a1fd-9c814df56c54 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:39.911137 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28ff4773-4cce-4ec9-a1fd-9c814df56c54 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:39.911904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28ff4773-4cce-4ec9-a1fd-9c814df56c54 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:39.914781 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28ff4773-4cce-4ec9-a1fd-9c814df56c54 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:39.915520 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28ff4773-4cce-4ec9-a1fd-9c814df56c54 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:39.917416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28ff4773-4cce-4ec9-a1fd-9c814df56c54 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:39.967459 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b1da1c8a-f7ea-4762-aef3-1efec4f03160 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:39.968081 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b1da1c8a-f7ea-4762-aef3-1efec4f03160 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:39.980180 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b1da1c8a-f7ea-4762-aef3-1efec4f03160 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:39.981403 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b1da1c8a-f7ea-4762-aef3-1efec4f03160 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:39.982016 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b1da1c8a-f7ea-4762-aef3-1efec4f03160 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:39.984639 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b1da1c8a-f7ea-4762-aef3-1efec4f03160 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:39.987619 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b1da1c8a-f7ea-4762-aef3-1efec4f03160 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:39.988255 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b1da1c8a-f7ea-4762-aef3-1efec4f03160 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:40.379987 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-28ff4773-4cce-4ec9-a1fd-9c814df56c54 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:40.391087 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b1da1c8a-f7ea-4762-aef3-1efec4f03160 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:40.408062 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-28ff4773-4cce-4ec9-a1fd-9c814df56c54 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1510 microversion: 2.1 time: 0.517400 Oct 04 03:31:40.411086 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b1da1c8a-f7ea-4762-aef3-1efec4f03160 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.447405 Oct 04 03:31:40.413271 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 143/285] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:39 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:40.415615 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 143/286] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:39 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1510 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:40.526176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a26cc281-f056-46bf-9bee-e1152acaff2d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:40.527047 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a26cc281-f056-46bf-9bee-e1152acaff2d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:40.539366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a26cc281-f056-46bf-9bee-e1152acaff2d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:40.540418 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a26cc281-f056-46bf-9bee-e1152acaff2d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:40.541611 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a26cc281-f056-46bf-9bee-e1152acaff2d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:40.542982 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a26cc281-f056-46bf-9bee-e1152acaff2d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:40.544098 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a26cc281-f056-46bf-9bee-e1152acaff2d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:40.545082 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a26cc281-f056-46bf-9bee-e1152acaff2d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:40.553269 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:40.665450 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d5786486-963c-41b8-8bc3-d45e935e0a7e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:40.673296 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d5786486-963c-41b8-8bc3-d45e935e0a7e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:40.690145 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d5786486-963c-41b8-8bc3-d45e935e0a7e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:40.695874 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d5786486-963c-41b8-8bc3-d45e935e0a7e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:40.707413 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d5786486-963c-41b8-8bc3-d45e935e0a7e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:40.709044 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d5786486-963c-41b8-8bc3-d45e935e0a7e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:40.712062 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d5786486-963c-41b8-8bc3-d45e935e0a7e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:40.712835 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d5786486-963c-41b8-8bc3-d45e935e0a7e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:40.996131 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a26cc281-f056-46bf-9bee-e1152acaff2d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:41.009196 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a26cc281-f056-46bf-9bee-e1152acaff2d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:41.010906 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a26cc281-f056-46bf-9bee-e1152acaff2d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:41.013178 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a26cc281-f056-46bf-9bee-e1152acaff2d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.491669 Oct 04 03:31:41.027275 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 144/287] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:40 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:41.130391 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=4 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:41.174958 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d5786486-963c-41b8-8bc3-d45e935e0a7e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:41.186763 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d5786486-963c-41b8-8bc3-d45e935e0a7e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1367 microversion: 2.1 time: 0.532630 Oct 04 03:31:41.187725 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 144/288] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:40 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1367 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:41.444711 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f3ea61af-4cb5-4749-bbf8-30ec94cd224f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:41.445492 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f3ea61af-4cb5-4749-bbf8-30ec94cd224f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:41.452883 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6d789758-6c04-42d8-8c32-6a98bd05b9aa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:41.454102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6d789758-6c04-42d8-8c32-6a98bd05b9aa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:41.456030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f3ea61af-4cb5-4749-bbf8-30ec94cd224f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:41.456530 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f3ea61af-4cb5-4749-bbf8-30ec94cd224f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:41.456980 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f3ea61af-4cb5-4749-bbf8-30ec94cd224f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:41.457682 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f3ea61af-4cb5-4749-bbf8-30ec94cd224f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:41.458133 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f3ea61af-4cb5-4749-bbf8-30ec94cd224f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:41.458561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f3ea61af-4cb5-4749-bbf8-30ec94cd224f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:41.471530 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d789758-6c04-42d8-8c32-6a98bd05b9aa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:41.474666 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d789758-6c04-42d8-8c32-6a98bd05b9aa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:41.478246 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d789758-6c04-42d8-8c32-6a98bd05b9aa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:41.479278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d789758-6c04-42d8-8c32-6a98bd05b9aa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:41.480680 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d789758-6c04-42d8-8c32-6a98bd05b9aa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:41.482161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d789758-6c04-42d8-8c32-6a98bd05b9aa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:41.847335 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6d789758-6c04-42d8-8c32-6a98bd05b9aa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:41.859363 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6d789758-6c04-42d8-8c32-6a98bd05b9aa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.410130 Oct 04 03:31:41.862429 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 145/289] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:41 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:31:41.864833 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f3ea61af-4cb5-4749-bbf8-30ec94cd224f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:41.883667 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f3ea61af-4cb5-4749-bbf8-30ec94cd224f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1516 microversion: 2.1 time: 0.441340 Oct 04 03:31:41.884644 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 145/290] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:41 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1516 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:42.045972 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-cd55229b-67c8-475d-9b9e-70484bedfff1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:42.046643 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-cd55229b-67c8-475d-9b9e-70484bedfff1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:42.054694 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cd55229b-67c8-475d-9b9e-70484bedfff1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:42.055686 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cd55229b-67c8-475d-9b9e-70484bedfff1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:42.056311 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cd55229b-67c8-475d-9b9e-70484bedfff1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:42.057221 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cd55229b-67c8-475d-9b9e-70484bedfff1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:42.057947 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cd55229b-67c8-475d-9b9e-70484bedfff1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:42.058589 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cd55229b-67c8-475d-9b9e-70484bedfff1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:42.217614 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d7e0bb4b-9f44-4d32-90ba-3f365459dc93 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:42.218235 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d7e0bb4b-9f44-4d32-90ba-3f365459dc93 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:42.231092 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7e0bb4b-9f44-4d32-90ba-3f365459dc93 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:42.232620 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7e0bb4b-9f44-4d32-90ba-3f365459dc93 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:42.233572 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7e0bb4b-9f44-4d32-90ba-3f365459dc93 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:42.236041 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7e0bb4b-9f44-4d32-90ba-3f365459dc93 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:42.258684 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7e0bb4b-9f44-4d32-90ba-3f365459dc93 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:42.261164 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7e0bb4b-9f44-4d32-90ba-3f365459dc93 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:42.524423 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-cd55229b-67c8-475d-9b9e-70484bedfff1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:42.533291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-cd55229b-67c8-475d-9b9e-70484bedfff1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:42.543953 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-cd55229b-67c8-475d-9b9e-70484bedfff1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:42.545254 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-cd55229b-67c8-475d-9b9e-70484bedfff1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.505977 Oct 04 03:31:42.546936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 146/291] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:42 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:42.645387 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-d7e0bb4b-9f44-4d32-90ba-3f365459dc93 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:42.669663 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d7e0bb4b-9f44-4d32-90ba-3f365459dc93 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1367 microversion: 2.1 time: 0.454118 Oct 04 03:31:42.671423 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 146/292] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:42 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1367 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:31:42.768883 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-3d85954b-40f8-420d-b8f5-46e9b2f5dc56 req-886b238c-3b40-4221-86b0-34bbd1dfa782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a755ac-b03d-459e-ae14-f1242058a16d", "tag": "de114046-4ed3-41d6-9359-fb41b5df6907"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:42.778297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:42.791846 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-3d85954b-40f8-420d-b8f5-46e9b2f5dc56 req-886b238c-3b40-4221-86b0-34bbd1dfa782 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:42.792579 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-3d85954b-40f8-420d-b8f5-46e9b2f5dc56 req-886b238c-3b40-4221-86b0-34bbd1dfa782 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:42.793204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-3d85954b-40f8-420d-b8f5-46e9b2f5dc56 req-886b238c-3b40-4221-86b0-34bbd1dfa782 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:42.820170 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-3d85954b-40f8-420d-b8f5-46e9b2f5dc56 req-886b238c-3b40-4221-86b0-34bbd1dfa782 service nova] Creating event network-changed:de114046-4ed3-41d6-9359-fb41b5df6907 for instance 86a755ac-b03d-459e-ae14-f1242058a16d on hv-cinder-84914 Oct 04 03:31:42.825984 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-3d85954b-40f8-420d-b8f5-46e9b2f5dc56 req-886b238c-3b40-4221-86b0-34bbd1dfa782 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061086 Oct 04 03:31:42.827066 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 147/293] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:31:42.890044 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c7fdc54f-99e9-4959-a8bc-dc6615f4e615 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:42.890653 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c7fdc54f-99e9-4959-a8bc-dc6615f4e615 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:42.902150 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c7fdc54f-99e9-4959-a8bc-dc6615f4e615 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:42.902807 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c7fdc54f-99e9-4959-a8bc-dc6615f4e615 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:42.904397 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c7fdc54f-99e9-4959-a8bc-dc6615f4e615 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:42.906465 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c7fdc54f-99e9-4959-a8bc-dc6615f4e615 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:42.906959 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c7fdc54f-99e9-4959-a8bc-dc6615f4e615 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:42.907383 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c7fdc54f-99e9-4959-a8bc-dc6615f4e615 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:43.158102 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c7fdc54f-99e9-4959-a8bc-dc6615f4e615 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:43.169016 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c7fdc54f-99e9-4959-a8bc-dc6615f4e615 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.283971 Oct 04 03:31:43.170601 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 147/294] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:42 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:43.511101 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-33da2ffc-ca3e-4bbb-8bce-fcca8909bba8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Action: 'create', calling method: .version_select at 0x7f165b666040>, body: {"keypair": {"name": "tempest-keypair-111869487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8Oc2PJfFXkY4OOcVzQf0UghHxXVOZ6lMyuOO2EqgM3tqiWLiNARSk74426lS5yygt/u8s27tBqQXF3IQgZ60OBV9aAI9nFcSwid/9d5J63oh01yEGtgFURmQA4TTR0/w=="}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:43.539425 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-33da2ffc-ca3e-4bbb-8bce-fcca8909bba8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Getting quotas for project b62fd4925f3840edb9806630cd78c9fa. Resources: {'key_pairs'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:31:43.544466 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-33da2ffc-ca3e-4bbb-8bce-fcca8909bba8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Getting quotas for user a267cf7109c64f538824c162fedd084b and project b62fd4925f3840edb9806630cd78c9fa. Resources: {'key_pairs'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:31:43.574711 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c4d0011d-2bf2-49b2-b992-b11fb2fcc222 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:43.576324 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c4d0011d-2bf2-49b2-b992-b11fb2fcc222 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:43.579069 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-33da2ffc-ca3e-4bbb-8bce-fcca8909bba8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072825 Oct 04 03:31:43.580417 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 148/295] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Oct 4 03:31:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:31:43.584218 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4d0011d-2bf2-49b2-b992-b11fb2fcc222 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:43.585380 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4d0011d-2bf2-49b2-b992-b11fb2fcc222 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:43.586211 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4d0011d-2bf2-49b2-b992-b11fb2fcc222 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:43.587253 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4d0011d-2bf2-49b2-b992-b11fb2fcc222 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:43.602578 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4d0011d-2bf2-49b2-b992-b11fb2fcc222 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:43.603143 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4d0011d-2bf2-49b2-b992-b11fb2fcc222 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:43.698940 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d6835df1-22c0-4412-809f-c3dfe148f266 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:43.700043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d6835df1-22c0-4412-809f-c3dfe148f266 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:43.714900 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d6835df1-22c0-4412-809f-c3dfe148f266 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:43.720035 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d6835df1-22c0-4412-809f-c3dfe148f266 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:43.723603 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d6835df1-22c0-4412-809f-c3dfe148f266 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:43.725777 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d6835df1-22c0-4412-809f-c3dfe148f266 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:43.736400 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d6835df1-22c0-4412-809f-c3dfe148f266 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:43.736866 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d6835df1-22c0-4412-809f-c3dfe148f266 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:43.740163 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:44.014511 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c4d0011d-2bf2-49b2-b992-b11fb2fcc222 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:44.027768 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c4d0011d-2bf2-49b2-b992-b11fb2fcc222 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:44.029790 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c4d0011d-2bf2-49b2-b992-b11fb2fcc222 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:44.031546 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c4d0011d-2bf2-49b2-b992-b11fb2fcc222 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1741 microversion: 2.20 time: 0.461262 Oct 04 03:31:44.052665 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 148/296] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:43 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1741 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:44.056283 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d6835df1-22c0-4412-809f-c3dfe148f266 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:44.078296 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d6835df1-22c0-4412-809f-c3dfe148f266 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1367 microversion: 2.1 time: 0.383288 Oct 04 03:31:44.078997 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 149/297] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:43 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:44.196441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b32ab512-e2cf-4ec3-a14f-42f801251fa3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:44.196973 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b32ab512-e2cf-4ec3-a14f-42f801251fa3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:44.208193 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b32ab512-e2cf-4ec3-a14f-42f801251fa3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:44.209315 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b32ab512-e2cf-4ec3-a14f-42f801251fa3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:44.210404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b32ab512-e2cf-4ec3-a14f-42f801251fa3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:44.211702 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b32ab512-e2cf-4ec3-a14f-42f801251fa3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:44.212341 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b32ab512-e2cf-4ec3-a14f-42f801251fa3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:44.212994 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b32ab512-e2cf-4ec3-a14f-42f801251fa3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:44.502883 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b32ab512-e2cf-4ec3-a14f-42f801251fa3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:44.516092 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b32ab512-e2cf-4ec3-a14f-42f801251fa3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.324100 Oct 04 03:31:44.519597 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 149/298] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:44 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:45.063995 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-028b6374-490e-433a-9842-7f70498ccdbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:45.064589 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-028b6374-490e-433a-9842-7f70498ccdbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:45.073849 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-028b6374-490e-433a-9842-7f70498ccdbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:45.074363 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-028b6374-490e-433a-9842-7f70498ccdbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:45.074978 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-028b6374-490e-433a-9842-7f70498ccdbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:45.076526 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-028b6374-490e-433a-9842-7f70498ccdbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:45.077012 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-028b6374-490e-433a-9842-7f70498ccdbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:45.077444 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-028b6374-490e-433a-9842-7f70498ccdbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:45.107424 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a6f6b352-72e2-4a09-939a-7b23930de825 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:45.108857 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a6f6b352-72e2-4a09-939a-7b23930de825 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:45.131845 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6f6b352-72e2-4a09-939a-7b23930de825 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:45.137225 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6f6b352-72e2-4a09-939a-7b23930de825 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:45.139044 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6f6b352-72e2-4a09-939a-7b23930de825 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:45.140564 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6f6b352-72e2-4a09-939a-7b23930de825 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:45.141960 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6f6b352-72e2-4a09-939a-7b23930de825 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:45.143254 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6f6b352-72e2-4a09-939a-7b23930de825 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:45.383977 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:45.550299 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a6f6b352-72e2-4a09-939a-7b23930de825 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:45.570917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-028b6374-490e-433a-9842-7f70498ccdbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:45.571180 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a6f6b352-72e2-4a09-939a-7b23930de825 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1367 microversion: 2.1 time: 0.472806 Oct 04 03:31:45.571678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 150/299] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:45 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1367 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:31:45.592792 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a1d68449-be0d-4965-b77c-a2f7318dc909 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:45.593410 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a1d68449-be0d-4965-b77c-a2f7318dc909 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:45.600044 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-028b6374-490e-433a-9842-7f70498ccdbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:45.601503 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-028b6374-490e-433a-9842-7f70498ccdbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:45.602761 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-028b6374-490e-433a-9842-7f70498ccdbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1741 microversion: 2.20 time: 0.544439 Oct 04 03:31:45.606200 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 150/300] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:45 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1741 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:45.611852 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1d68449-be0d-4965-b77c-a2f7318dc909 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:45.612350 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1d68449-be0d-4965-b77c-a2f7318dc909 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:45.612786 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1d68449-be0d-4965-b77c-a2f7318dc909 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:45.613510 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1d68449-be0d-4965-b77c-a2f7318dc909 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:45.619945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1d68449-be0d-4965-b77c-a2f7318dc909 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:45.620660 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1d68449-be0d-4965-b77c-a2f7318dc909 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:45.857928 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=8 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:45.930105 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a1d68449-be0d-4965-b77c-a2f7318dc909 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:45.950213 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a1d68449-be0d-4965-b77c-a2f7318dc909 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1722 microversion: 2.1 time: 0.377491 Oct 04 03:31:45.950956 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 151/301] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:45 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1722 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:46.080729 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1308528689", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "053cc780-a24b-4a11-8b58-f28b74a4a8ee"}], "security_groups": [{"name": "tempest-securitygroup--1468356613"}], "key_name": "tempest-keypair-111869487", "user_data": "}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:46.309372 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.network.neutron [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] validate_networks() for [('053cc780-a24b-4a11-8b58-f28b74a4a8ee', None, None, None, None, None)] {{(pid=120595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:31:46.595132 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9089198d-58cc-47a4-8cc1-b3f55da9a56c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:46.596754 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9089198d-58cc-47a4-8cc1-b3f55da9a56c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:46.610604 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9089198d-58cc-47a4-8cc1-b3f55da9a56c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:46.611355 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9089198d-58cc-47a4-8cc1-b3f55da9a56c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:46.613506 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9089198d-58cc-47a4-8cc1-b3f55da9a56c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:46.614454 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9089198d-58cc-47a4-8cc1-b3f55da9a56c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:46.616945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9089198d-58cc-47a4-8cc1-b3f55da9a56c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:46.617751 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9089198d-58cc-47a4-8cc1-b3f55da9a56c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:46.987328 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9089198d-58cc-47a4-8cc1-b3f55da9a56c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:47.002554 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9089198d-58cc-47a4-8cc1-b3f55da9a56c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1367 microversion: 2.1 time: 0.411588 Oct 04 03:31:47.015515 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 152/302] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:46 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:47.021127 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a83bffcb-4b76-44bb-a97e-38c38d5c1eb0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:47.021127 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a83bffcb-4b76-44bb-a97e-38c38d5c1eb0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:47.046602 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a83bffcb-4b76-44bb-a97e-38c38d5c1eb0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:47.047268 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a83bffcb-4b76-44bb-a97e-38c38d5c1eb0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:47.051063 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a83bffcb-4b76-44bb-a97e-38c38d5c1eb0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:47.051991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a83bffcb-4b76-44bb-a97e-38c38d5c1eb0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:47.052768 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a83bffcb-4b76-44bb-a97e-38c38d5c1eb0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:47.055742 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a83bffcb-4b76-44bb-a97e-38c38d5c1eb0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:47.429288 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Flavor limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:31:47.430541 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Image limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:31:47.431382 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Flavor pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:31:47.432101 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Image pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:31:47.432739 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:31:47.456084 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:47.456973 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:47.457635 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:47.458603 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:47.460210 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:47.461095 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:47.502199 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Getting quotas for project b62fd4925f3840edb9806630cd78c9fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:31:47.513205 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Getting quotas for user a267cf7109c64f538824c162fedd084b and project b62fd4925f3840edb9806630cd78c9fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:31:47.542382 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Going to run 1 instances... {{(pid=120595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:31:47.552500 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:31:47.668464 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a83bffcb-4b76-44bb-a97e-38c38d5c1eb0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:47.683670 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a83bffcb-4b76-44bb-a97e-38c38d5c1eb0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:47.686635 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a83bffcb-4b76-44bb-a97e-38c38d5c1eb0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:47.688440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-108a1e69-8955-4663-9be7-b80fa136692a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.612498 Oct 04 03:31:47.690049 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a83bffcb-4b76-44bb-a97e-38c38d5c1eb0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1736 microversion: 2.20 time: 0.681974 Oct 04 03:31:47.691666 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 151/303] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:31:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 03:31:47.691926 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 153/304] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:47 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1736 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:47.697880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-dea57ed1-70f3-4dc0-86e1-d5925811d950 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:47.704828 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-88d9e707-49f7-4504-a46c-b8665c43dfc4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:47.705744 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-88d9e707-49f7-4504-a46c-b8665c43dfc4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:47.707159 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-dea57ed1-70f3-4dc0-86e1-d5925811d950 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:47.723123 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dea57ed1-70f3-4dc0-86e1-d5925811d950 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:47.725901 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dea57ed1-70f3-4dc0-86e1-d5925811d950 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:47.727585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dea57ed1-70f3-4dc0-86e1-d5925811d950 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:47.729647 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dea57ed1-70f3-4dc0-86e1-d5925811d950 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:47.732436 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dea57ed1-70f3-4dc0-86e1-d5925811d950 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:47.733176 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dea57ed1-70f3-4dc0-86e1-d5925811d950 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:47.854798 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-88d9e707-49f7-4504-a46c-b8665c43dfc4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:47.871683 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-88d9e707-49f7-4504-a46c-b8665c43dfc4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1245 microversion: 2.1 time: 0.166760 Oct 04 03:31:47.887647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 154/305] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:47 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1245 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:48.031733 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d73d2da2-92d9-4a3a-9644-a37ddc824e48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:48.031733 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d73d2da2-92d9-4a3a-9644-a37ddc824e48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:48.045149 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d73d2da2-92d9-4a3a-9644-a37ddc824e48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:48.060096 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d73d2da2-92d9-4a3a-9644-a37ddc824e48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:48.061055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d73d2da2-92d9-4a3a-9644-a37ddc824e48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:48.070347 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d73d2da2-92d9-4a3a-9644-a37ddc824e48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:48.073859 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d73d2da2-92d9-4a3a-9644-a37ddc824e48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:48.078286 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d73d2da2-92d9-4a3a-9644-a37ddc824e48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:48.300488 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-dea57ed1-70f3-4dc0-86e1-d5925811d950 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:48.331377 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-dea57ed1-70f3-4dc0-86e1-d5925811d950 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1699 microversion: 2.1 time: 0.635130 Oct 04 03:31:48.339927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 152/306] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:47 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1699 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:48.345447 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-6a80f436-b753-4d90-8ebf-32e88ef12506 req-1a5462e4-8852-46e2-b287-5bec8f9e3691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f680f852-0ad9-4478-912f-1821b7755927", "name": "network-vif-plugged", "status": "completed", "tag": "b303180f-7432-4f63-b46d-6cc9c707c0d6"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:48.392824 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-6a80f436-b753-4d90-8ebf-32e88ef12506 req-1a5462e4-8852-46e2-b287-5bec8f9e3691 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:48.411068 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-6a80f436-b753-4d90-8ebf-32e88ef12506 req-1a5462e4-8852-46e2-b287-5bec8f9e3691 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:48.411966 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-6a80f436-b753-4d90-8ebf-32e88ef12506 req-1a5462e4-8852-46e2-b287-5bec8f9e3691 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:48.478065 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-6a80f436-b753-4d90-8ebf-32e88ef12506 req-1a5462e4-8852-46e2-b287-5bec8f9e3691 service nova] Creating event network-vif-plugged:b303180f-7432-4f63-b46d-6cc9c707c0d6 for instance f680f852-0ad9-4478-912f-1821b7755927 on hv-cinder-84914 Oct 04 03:31:48.506223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-6a80f436-b753-4d90-8ebf-32e88ef12506 req-1a5462e4-8852-46e2-b287-5bec8f9e3691 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163912 Oct 04 03:31:48.509635 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 153/307] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:31:48.535869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-df9935bd-fe40-4491-a83c-63025e0ebcec tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:48.554135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-df9935bd-fe40-4491-a83c-63025e0ebcec tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:48.554887 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-df9935bd-fe40-4491-a83c-63025e0ebcec tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:48.555505 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-df9935bd-fe40-4491-a83c-63025e0ebcec tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:48.700377 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-d73d2da2-92d9-4a3a-9644-a37ddc824e48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:48.735174 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d73d2da2-92d9-4a3a-9644-a37ddc824e48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1367 microversion: 2.1 time: 0.691541 Oct 04 03:31:48.737181 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 155/308] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:48 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1367 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:48.748622 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e36750a7-bc94-467f-968a-bebef6232845 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:48.749645 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e36750a7-bc94-467f-968a-bebef6232845 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:48.789729 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e36750a7-bc94-467f-968a-bebef6232845 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:48.790215 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e36750a7-bc94-467f-968a-bebef6232845 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:48.790713 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e36750a7-bc94-467f-968a-bebef6232845 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:48.791544 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e36750a7-bc94-467f-968a-bebef6232845 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:48.795317 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e36750a7-bc94-467f-968a-bebef6232845 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:48.795863 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e36750a7-bc94-467f-968a-bebef6232845 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:48.822749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-df9935bd-fe40-4491-a83c-63025e0ebcec tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Going to try to start instance {{(pid=120595) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 03:31:48.952950 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-df9935bd-fe40-4491-a83c-63025e0ebcec tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "POST /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/action" status: 202 len: 0 microversion: 2.1 time: 0.441446 Oct 04 03:31:48.954665 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 154/309] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Oct 4 03:31:48 2022] POST /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:31:48.983660 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f624673e-f319-466a-a08e-56a2b4f74535 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:48.986607 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f624673e-f319-466a-a08e-56a2b4f74535 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:49.005224 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f624673e-f319-466a-a08e-56a2b4f74535 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:49.009269 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f624673e-f319-466a-a08e-56a2b4f74535 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:49.012445 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f624673e-f319-466a-a08e-56a2b4f74535 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:49.013586 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f624673e-f319-466a-a08e-56a2b4f74535 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:49.014346 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f624673e-f319-466a-a08e-56a2b4f74535 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:49.015735 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f624673e-f319-466a-a08e-56a2b4f74535 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:49.189051 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f624673e-f319-466a-a08e-56a2b4f74535 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:49.201207 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f624673e-f319-466a-a08e-56a2b4f74535 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1249 microversion: 2.1 time: 0.233434 Oct 04 03:31:49.202377 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 155/310] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:48 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1249 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:49.209953 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-ff69d67a-3378-480f-8970-558b46e2572f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:49.211059 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-ff69d67a-3378-480f-8970-558b46e2572f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:49.218204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ff69d67a-3378-480f-8970-558b46e2572f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:49.219135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ff69d67a-3378-480f-8970-558b46e2572f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:49.219831 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ff69d67a-3378-480f-8970-558b46e2572f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:49.220964 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ff69d67a-3378-480f-8970-558b46e2572f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:49.221597 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ff69d67a-3378-480f-8970-558b46e2572f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:49.222181 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ff69d67a-3378-480f-8970-558b46e2572f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:49.276924 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e36750a7-bc94-467f-968a-bebef6232845 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:49.288854 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e36750a7-bc94-467f-968a-bebef6232845 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:49.290459 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e36750a7-bc94-467f-968a-bebef6232845 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:49.311855 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e36750a7-bc94-467f-968a-bebef6232845 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1736 microversion: 2.20 time: 0.553352 Oct 04 03:31:49.312526 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 156/311] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:48 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1736 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:49.727086 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-ff69d67a-3378-480f-8970-558b46e2572f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:49.747082 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-ff69d67a-3378-480f-8970-558b46e2572f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1708 microversion: 2.1 time: 0.543464 Oct 04 03:31:49.748206 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 156/312] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:49 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1708 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:49.769540 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d3103064-f903-40cb-bff5-f3e95dcd4479 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:49.771355 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d3103064-f903-40cb-bff5-f3e95dcd4479 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:49.797769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d3103064-f903-40cb-bff5-f3e95dcd4479 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:49.799226 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d3103064-f903-40cb-bff5-f3e95dcd4479 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:49.805261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d3103064-f903-40cb-bff5-f3e95dcd4479 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:49.808165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d3103064-f903-40cb-bff5-f3e95dcd4479 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:49.811129 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d3103064-f903-40cb-bff5-f3e95dcd4479 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:49.811780 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d3103064-f903-40cb-bff5-f3e95dcd4479 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:50.231106 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-da73d145-9408-46be-a54c-82f33484daae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:50.231759 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-da73d145-9408-46be-a54c-82f33484daae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:50.252675 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-da73d145-9408-46be-a54c-82f33484daae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:50.259366 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-da73d145-9408-46be-a54c-82f33484daae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:50.262701 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-da73d145-9408-46be-a54c-82f33484daae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:50.263652 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-da73d145-9408-46be-a54c-82f33484daae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:50.268951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-da73d145-9408-46be-a54c-82f33484daae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:50.269594 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-da73d145-9408-46be-a54c-82f33484daae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:50.587218 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-da73d145-9408-46be-a54c-82f33484daae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:50.597348 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-da73d145-9408-46be-a54c-82f33484daae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1305 microversion: 2.1 time: 0.372759 Oct 04 03:31:50.619690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 157/313] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:50 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1305 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:31:50.634384 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-27346ae6-f83d-495d-804f-50ebc6755b76 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:50.639677 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-27346ae6-f83d-495d-804f-50ebc6755b76 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:50.665821 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-d3103064-f903-40cb-bff5-f3e95dcd4479 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:50.672810 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-27346ae6-f83d-495d-804f-50ebc6755b76 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:50.674956 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-27346ae6-f83d-495d-804f-50ebc6755b76 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:50.679284 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d3103064-f903-40cb-bff5-f3e95dcd4479 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1367 microversion: 2.1 time: 0.920249 Oct 04 03:31:50.681788 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-27346ae6-f83d-495d-804f-50ebc6755b76 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:50.691537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-27346ae6-f83d-495d-804f-50ebc6755b76 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:50.691537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-27346ae6-f83d-495d-804f-50ebc6755b76 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:50.691537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-27346ae6-f83d-495d-804f-50ebc6755b76 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:50.707525 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 157/314] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:49 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1367 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:50.724227 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-38314c22-727b-4633-849e-10498b9ea080 req-b334c323-1b95-4c86-bd0a-b75bb6488f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a755ac-b03d-459e-ae14-f1242058a16d", "name": "network-vif-plugged", "status": "completed", "tag": "de114046-4ed3-41d6-9359-fb41b5df6907"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:50.737901 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-38314c22-727b-4633-849e-10498b9ea080 req-b334c323-1b95-4c86-bd0a-b75bb6488f43 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:50.738590 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-38314c22-727b-4633-849e-10498b9ea080 req-b334c323-1b95-4c86-bd0a-b75bb6488f43 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:50.739172 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-38314c22-727b-4633-849e-10498b9ea080 req-b334c323-1b95-4c86-bd0a-b75bb6488f43 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:50.754600 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-38314c22-727b-4633-849e-10498b9ea080 req-b334c323-1b95-4c86-bd0a-b75bb6488f43 service nova] Creating event network-vif-plugged:de114046-4ed3-41d6-9359-fb41b5df6907 for instance 86a755ac-b03d-459e-ae14-f1242058a16d on hv-cinder-84914 Oct 04 03:31:50.760361 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-38314c22-727b-4633-849e-10498b9ea080 req-b334c323-1b95-4c86-bd0a-b75bb6488f43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051045 Oct 04 03:31:50.765750 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 158/315] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:31:50.774479 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-febbdb63-d57e-4430-ab72-1f87b07a6ac0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:50.776093 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-febbdb63-d57e-4430-ab72-1f87b07a6ac0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:50.784931 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-febbdb63-d57e-4430-ab72-1f87b07a6ac0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:50.785742 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-febbdb63-d57e-4430-ab72-1f87b07a6ac0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:50.786405 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-febbdb63-d57e-4430-ab72-1f87b07a6ac0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:50.788249 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-febbdb63-d57e-4430-ab72-1f87b07a6ac0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:50.789147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-febbdb63-d57e-4430-ab72-1f87b07a6ac0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:50.789810 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-febbdb63-d57e-4430-ab72-1f87b07a6ac0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:51.307744 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-27346ae6-f83d-495d-804f-50ebc6755b76 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:51.328062 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-27346ae6-f83d-495d-804f-50ebc6755b76 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:51.331195 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-27346ae6-f83d-495d-804f-50ebc6755b76 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:51.332802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-27346ae6-f83d-495d-804f-50ebc6755b76 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1736 microversion: 2.20 time: 0.718709 Oct 04 03:31:51.348607 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 158/316] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:50 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1736 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:51.394752 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-febbdb63-d57e-4430-ab72-1f87b07a6ac0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:51.415909 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-febbdb63-d57e-4430-ab72-1f87b07a6ac0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1708 microversion: 2.1 time: 0.647557 Oct 04 03:31:51.432910 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 159/317] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:50 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1708 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:51.625857 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-761c6f2f-23ab-4e1e-a76a-1838514901d2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:51.626433 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-761c6f2f-23ab-4e1e-a76a-1838514901d2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:51.649844 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-761c6f2f-23ab-4e1e-a76a-1838514901d2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:51.650550 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-761c6f2f-23ab-4e1e-a76a-1838514901d2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:51.651153 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-761c6f2f-23ab-4e1e-a76a-1838514901d2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:51.652037 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-761c6f2f-23ab-4e1e-a76a-1838514901d2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:51.652630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-761c6f2f-23ab-4e1e-a76a-1838514901d2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:51.653225 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-761c6f2f-23ab-4e1e-a76a-1838514901d2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:51.715847 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-eeaace81-f8fd-431e-aa04-5b9958b9f0ca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:51.715847 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-eeaace81-f8fd-431e-aa04-5b9958b9f0ca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:51.722886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eeaace81-f8fd-431e-aa04-5b9958b9f0ca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:51.723373 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eeaace81-f8fd-431e-aa04-5b9958b9f0ca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:51.723833 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eeaace81-f8fd-431e-aa04-5b9958b9f0ca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:51.724556 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eeaace81-f8fd-431e-aa04-5b9958b9f0ca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:51.728833 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eeaace81-f8fd-431e-aa04-5b9958b9f0ca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:51.729280 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eeaace81-f8fd-431e-aa04-5b9958b9f0ca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:51.745162 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-761c6f2f-23ab-4e1e-a76a-1838514901d2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:51.761587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-761c6f2f-23ab-4e1e-a76a-1838514901d2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1303 microversion: 2.1 time: 0.139684 Oct 04 03:31:51.763707 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 159/318] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:51 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1303 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:51.988892 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-eeaace81-f8fd-431e-aa04-5b9958b9f0ca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:51.998247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-eeaace81-f8fd-431e-aa04-5b9958b9f0ca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1367 microversion: 2.1 time: 0.291069 Oct 04 03:31:51.999470 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 160/319] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:51 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:52.362821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-1bf2bae4-e644-420a-b8c0-1224a9edbb61 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:52.364054 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-1bf2bae4-e644-420a-b8c0-1224a9edbb61 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:52.378328 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1bf2bae4-e644-420a-b8c0-1224a9edbb61 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:52.378995 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1bf2bae4-e644-420a-b8c0-1224a9edbb61 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:52.379420 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1bf2bae4-e644-420a-b8c0-1224a9edbb61 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:52.380309 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1bf2bae4-e644-420a-b8c0-1224a9edbb61 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:52.381973 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1bf2bae4-e644-420a-b8c0-1224a9edbb61 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:52.382613 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1bf2bae4-e644-420a-b8c0-1224a9edbb61 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:52.462927 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1d3d9887-47cf-4397-ae3b-125213b81db2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:52.464743 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1d3d9887-47cf-4397-ae3b-125213b81db2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:52.482211 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d3d9887-47cf-4397-ae3b-125213b81db2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:52.482707 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d3d9887-47cf-4397-ae3b-125213b81db2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:52.483135 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d3d9887-47cf-4397-ae3b-125213b81db2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:52.483852 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d3d9887-47cf-4397-ae3b-125213b81db2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:52.484784 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d3d9887-47cf-4397-ae3b-125213b81db2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:52.485349 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d3d9887-47cf-4397-ae3b-125213b81db2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:52.830713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-1bf2bae4-e644-420a-b8c0-1224a9edbb61 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:52.851419 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1d3d9887-47cf-4397-ae3b-125213b81db2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:52.860296 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1d3d9887-47cf-4397-ae3b-125213b81db2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1708 microversion: 2.1 time: 0.421694 Oct 04 03:31:52.860865 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 161/320] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:52 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1708 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:31:52.891718 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-1bf2bae4-e644-420a-b8c0-1224a9edbb61 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:52.893868 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-1bf2bae4-e644-420a-b8c0-1224a9edbb61 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:52.899073 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-1bf2bae4-e644-420a-b8c0-1224a9edbb61 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1736 microversion: 2.20 time: 0.542468 Oct 04 03:31:52.900572 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-643778ba-aa93-4239-a9d5-94546fd55a23 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:52.902334 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 160/321] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:52 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1736 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:52.903481 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-643778ba-aa93-4239-a9d5-94546fd55a23 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:52.911938 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-643778ba-aa93-4239-a9d5-94546fd55a23 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:52.913813 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-643778ba-aa93-4239-a9d5-94546fd55a23 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:52.914182 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-643778ba-aa93-4239-a9d5-94546fd55a23 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:52.915392 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-643778ba-aa93-4239-a9d5-94546fd55a23 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:52.916024 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-643778ba-aa93-4239-a9d5-94546fd55a23 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:52.916684 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-643778ba-aa93-4239-a9d5-94546fd55a23 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:52.938230 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:53.023338 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-79ff0497-d458-4ab7-a798-865794137933 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:53.024114 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-79ff0497-d458-4ab7-a798-865794137933 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:53.043151 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79ff0497-d458-4ab7-a798-865794137933 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:53.044090 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79ff0497-d458-4ab7-a798-865794137933 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:53.044592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79ff0497-d458-4ab7-a798-865794137933 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:53.045399 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79ff0497-d458-4ab7-a798-865794137933 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:53.045857 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79ff0497-d458-4ab7-a798-865794137933 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:53.046299 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79ff0497-d458-4ab7-a798-865794137933 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:53.289242 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-643778ba-aa93-4239-a9d5-94546fd55a23 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:53.305444 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-643778ba-aa93-4239-a9d5-94546fd55a23 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1371 microversion: 2.1 time: 0.411613 Oct 04 03:31:53.306067 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 162/322] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:52 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1371 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:53.339956 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-79ff0497-d458-4ab7-a798-865794137933 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:53.347580 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-79ff0497-d458-4ab7-a798-865794137933 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1557 microversion: 2.1 time: 0.329650 Oct 04 03:31:53.348237 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 161/323] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:53 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1557 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:53.372707 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3f353384-4c16-4c86-9b3c-55aa9b79760e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:53.373623 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3f353384-4c16-4c86-9b3c-55aa9b79760e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:53.390138 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f353384-4c16-4c86-9b3c-55aa9b79760e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:53.392377 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f353384-4c16-4c86-9b3c-55aa9b79760e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:53.396362 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f353384-4c16-4c86-9b3c-55aa9b79760e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:53.398076 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f353384-4c16-4c86-9b3c-55aa9b79760e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:53.398945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f353384-4c16-4c86-9b3c-55aa9b79760e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:53.399521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f353384-4c16-4c86-9b3c-55aa9b79760e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:53.555781 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3f353384-4c16-4c86-9b3c-55aa9b79760e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180515 Oct 04 03:31:53.555781 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 163/324] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Oct 4 03:31:53 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:31:53.888909 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-68213165-c2b3-47df-99ce-bfefa7cb9657 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:53.891638 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-68213165-c2b3-47df-99ce-bfefa7cb9657 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:53.905590 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-68213165-c2b3-47df-99ce-bfefa7cb9657 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:53.914049 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-68213165-c2b3-47df-99ce-bfefa7cb9657 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:53.915280 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-68213165-c2b3-47df-99ce-bfefa7cb9657 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:53.916230 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-68213165-c2b3-47df-99ce-bfefa7cb9657 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:53.916860 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-68213165-c2b3-47df-99ce-bfefa7cb9657 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:53.917452 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-68213165-c2b3-47df-99ce-bfefa7cb9657 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:53.932612 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2a2801eb-61a0-4378-a037-3506e3a277ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:53.934906 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2a2801eb-61a0-4378-a037-3506e3a277ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:53.951989 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2a2801eb-61a0-4378-a037-3506e3a277ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:53.953509 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2a2801eb-61a0-4378-a037-3506e3a277ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:53.954012 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2a2801eb-61a0-4378-a037-3506e3a277ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:53.955983 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2a2801eb-61a0-4378-a037-3506e3a277ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:53.958356 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2a2801eb-61a0-4378-a037-3506e3a277ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:53.962536 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2a2801eb-61a0-4378-a037-3506e3a277ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:54.239912 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-68213165-c2b3-47df-99ce-bfefa7cb9657 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:54.248507 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-68213165-c2b3-47df-99ce-bfefa7cb9657 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1712 microversion: 2.1 time: 0.363819 Oct 04 03:31:54.249088 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 162/325] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:53 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1712 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:54.289655 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-082d9bce-b554-4ef0-bf8f-70bd9ff15f1e req-df91be2a-2b67-4914-80b8-5da9f9a2a5ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36a2b849-4aeb-4b38-8204-9a1b6c3983d8", "tag": "c33a6354-d3b9-46e0-8da8-baff5c9a347a"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:54.310668 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-082d9bce-b554-4ef0-bf8f-70bd9ff15f1e req-df91be2a-2b67-4914-80b8-5da9f9a2a5ad service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:54.311158 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-082d9bce-b554-4ef0-bf8f-70bd9ff15f1e req-df91be2a-2b67-4914-80b8-5da9f9a2a5ad service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:54.311609 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-082d9bce-b554-4ef0-bf8f-70bd9ff15f1e req-df91be2a-2b67-4914-80b8-5da9f9a2a5ad service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:54.314451 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2a2801eb-61a0-4378-a037-3506e3a277ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:54.329362 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2a2801eb-61a0-4378-a037-3506e3a277ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:54.335185 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2a2801eb-61a0-4378-a037-3506e3a277ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:54.336988 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2a2801eb-61a0-4378-a037-3506e3a277ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1736 microversion: 2.20 time: 0.409210 Oct 04 03:31:54.338239 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 164/326] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:53 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1736 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:54.362301 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f52b62a6-2c30-43cc-9843-d642246d8d33 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:54.369793 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-082d9bce-b554-4ef0-bf8f-70bd9ff15f1e req-df91be2a-2b67-4914-80b8-5da9f9a2a5ad service nova] Creating event network-changed:c33a6354-d3b9-46e0-8da8-baff5c9a347a for instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 on hv-cinder-84914 Oct 04 03:31:54.374610 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f52b62a6-2c30-43cc-9843-d642246d8d33 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:54.377935 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-082d9bce-b554-4ef0-bf8f-70bd9ff15f1e req-df91be2a-2b67-4914-80b8-5da9f9a2a5ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090096 Oct 04 03:31:54.379114 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 163/327] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:31:54.393472 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f52b62a6-2c30-43cc-9843-d642246d8d33 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:54.394455 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f52b62a6-2c30-43cc-9843-d642246d8d33 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:54.401461 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f52b62a6-2c30-43cc-9843-d642246d8d33 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:54.404275 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f52b62a6-2c30-43cc-9843-d642246d8d33 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:54.406272 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f52b62a6-2c30-43cc-9843-d642246d8d33 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:54.407916 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f52b62a6-2c30-43cc-9843-d642246d8d33 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:54.930719 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f52b62a6-2c30-43cc-9843-d642246d8d33 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:54.944044 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f52b62a6-2c30-43cc-9843-d642246d8d33 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1371 microversion: 2.1 time: 0.603544 Oct 04 03:31:54.948809 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 165/328] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:54 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1371 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:55.363275 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a48d83db-54f2-40f3-afdb-148a52c7f775 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:55.364000 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a48d83db-54f2-40f3-afdb-148a52c7f775 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:55.376833 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a48d83db-54f2-40f3-afdb-148a52c7f775 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:55.377327 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a48d83db-54f2-40f3-afdb-148a52c7f775 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:55.377764 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a48d83db-54f2-40f3-afdb-148a52c7f775 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:55.378479 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a48d83db-54f2-40f3-afdb-148a52c7f775 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:55.378929 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a48d83db-54f2-40f3-afdb-148a52c7f775 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:55.379356 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a48d83db-54f2-40f3-afdb-148a52c7f775 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:55.496996 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-b70483da-b5d5-4f21-be73-08e23de733c8 req-72bc7b31-c1e1-4ef6-8391-e36b951bbcba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a755ac-b03d-459e-ae14-f1242058a16d", "tag": "de114046-4ed3-41d6-9359-fb41b5df6907"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:55.520483 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b70483da-b5d5-4f21-be73-08e23de733c8 req-72bc7b31-c1e1-4ef6-8391-e36b951bbcba service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:55.521154 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b70483da-b5d5-4f21-be73-08e23de733c8 req-72bc7b31-c1e1-4ef6-8391-e36b951bbcba service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:55.522401 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b70483da-b5d5-4f21-be73-08e23de733c8 req-72bc7b31-c1e1-4ef6-8391-e36b951bbcba service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:55.537675 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-b70483da-b5d5-4f21-be73-08e23de733c8 req-72bc7b31-c1e1-4ef6-8391-e36b951bbcba service nova] Creating event network-changed:de114046-4ed3-41d6-9359-fb41b5df6907 for instance 86a755ac-b03d-459e-ae14-f1242058a16d on hv-cinder-84914 Oct 04 03:31:55.558436 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-b70483da-b5d5-4f21-be73-08e23de733c8 req-72bc7b31-c1e1-4ef6-8391-e36b951bbcba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066664 Oct 04 03:31:55.559234 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 166/329] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:31:55.686550 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a48d83db-54f2-40f3-afdb-148a52c7f775 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:55.702540 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a48d83db-54f2-40f3-afdb-148a52c7f775 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:55.705792 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a48d83db-54f2-40f3-afdb-148a52c7f775 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:55.716848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a48d83db-54f2-40f3-afdb-148a52c7f775 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1736 microversion: 2.20 time: 0.358225 Oct 04 03:31:55.718061 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 164/330] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:55 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1736 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:55.892966 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2007255520", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "networks": [{"uuid": "2e050f8e-f47a-49fb-bab9-f88f333ac543"}]}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:31:55.971473 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a6db5d5f-4aae-4040-a870-983148814ef3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:55.972514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a6db5d5f-4aae-4040-a870-983148814ef3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:55.984371 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] validate_networks() for [('2e050f8e-f47a-49fb-bab9-f88f333ac543', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:31:56.010483 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a6db5d5f-4aae-4040-a870-983148814ef3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:56.012207 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a6db5d5f-4aae-4040-a870-983148814ef3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:56.013533 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a6db5d5f-4aae-4040-a870-983148814ef3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:56.014772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a6db5d5f-4aae-4040-a870-983148814ef3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:56.015530 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a6db5d5f-4aae-4040-a870-983148814ef3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:56.016245 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a6db5d5f-4aae-4040-a870-983148814ef3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:56.323279 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a6db5d5f-4aae-4040-a870-983148814ef3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:56.334732 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a6db5d5f-4aae-4040-a870-983148814ef3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1371 microversion: 2.1 time: 0.366309 Oct 04 03:31:56.344735 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 165/331] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:55 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1371 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:56.734359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:31:56.734844 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:31:56.735252 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:31:56.736100 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:31:56.736671 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:31:56.750690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f9eac8e3-b732-4d7f-878f-34bdcb63e533 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:56.751459 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f9eac8e3-b732-4d7f-878f-34bdcb63e533 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:56.755881 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:56.756620 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:56.757216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:56.758140 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:56.760753 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:56.762375 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f9eac8e3-b732-4d7f-878f-34bdcb63e533 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:56.763280 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f9eac8e3-b732-4d7f-878f-34bdcb63e533 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:56.763575 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:56.765137 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f9eac8e3-b732-4d7f-878f-34bdcb63e533 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:56.766132 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f9eac8e3-b732-4d7f-878f-34bdcb63e533 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:56.768015 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f9eac8e3-b732-4d7f-878f-34bdcb63e533 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:56.769442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f9eac8e3-b732-4d7f-878f-34bdcb63e533 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:56.798152 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Getting quotas for project 3edbcf8484374dab9697bab576e6afdb. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:31:56.814522 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Getting quotas for user 4d1b67fec65345d3b7973445eab896b2 and project 3edbcf8484374dab9697bab576e6afdb. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:31:56.839752 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:31:56.846819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:31:56.970223 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-31aa6937-70d1-490a-8ca0-1bd300a5f41c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.081436 Oct 04 03:31:56.971605 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 167/332] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:31:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 03:31:56.985283 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6cb52511-fa25-4ac1-ad4e-057c84e32cca tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:56.986663 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6cb52511-fa25-4ac1-ad4e-057c84e32cca tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:57.197755 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6cb52511-fa25-4ac1-ad4e-057c84e32cca tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:57.207170 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6cb52511-fa25-4ac1-ad4e-057c84e32cca tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1219 microversion: 2.1 time: 0.227561 Oct 04 03:31:57.208045 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 168/333] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:56 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1219 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:57.352862 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f9eac8e3-b732-4d7f-878f-34bdcb63e533 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:57.361191 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b65d65a5-4bcf-4a71-9f27-8f48923cab67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:57.361960 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b65d65a5-4bcf-4a71-9f27-8f48923cab67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:57.362662 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:57.369024 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f9eac8e3-b732-4d7f-878f-34bdcb63e533 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:57.377117 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f9eac8e3-b732-4d7f-878f-34bdcb63e533 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:57.378191 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b65d65a5-4bcf-4a71-9f27-8f48923cab67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:57.384691 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f9eac8e3-b732-4d7f-878f-34bdcb63e533 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1736 microversion: 2.20 time: 0.637768 Oct 04 03:31:57.385291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 166/334] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:56 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1736 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:31:57.396037 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b65d65a5-4bcf-4a71-9f27-8f48923cab67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:57.396037 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b65d65a5-4bcf-4a71-9f27-8f48923cab67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:57.396037 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b65d65a5-4bcf-4a71-9f27-8f48923cab67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:57.396037 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b65d65a5-4bcf-4a71-9f27-8f48923cab67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:57.397678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b65d65a5-4bcf-4a71-9f27-8f48923cab67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:57.889703 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b65d65a5-4bcf-4a71-9f27-8f48923cab67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:57.901375 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b65d65a5-4bcf-4a71-9f27-8f48923cab67 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1371 microversion: 2.1 time: 0.544241 Oct 04 03:31:57.902006 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 169/335] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:57 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1371 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:58.230779 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0d57fd2b-1a5f-4dff-85e9-5e6e2d23f009 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:58.231392 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-0d57fd2b-1a5f-4dff-85e9-5e6e2d23f009 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:58.236633 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:58.242665 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=10 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:58.251977 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d57fd2b-1a5f-4dff-85e9-5e6e2d23f009 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:58.252918 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d57fd2b-1a5f-4dff-85e9-5e6e2d23f009 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:58.253671 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d57fd2b-1a5f-4dff-85e9-5e6e2d23f009 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:58.255398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d57fd2b-1a5f-4dff-85e9-5e6e2d23f009 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:58.256752 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d57fd2b-1a5f-4dff-85e9-5e6e2d23f009 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:58.257330 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d57fd2b-1a5f-4dff-85e9-5e6e2d23f009 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:58.338242 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0d57fd2b-1a5f-4dff-85e9-5e6e2d23f009 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:58.347548 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0d57fd2b-1a5f-4dff-85e9-5e6e2d23f009 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1215 microversion: 2.1 time: 0.120483 Oct 04 03:31:58.348778 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 167/336] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:58 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:58.414307 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1d5508e7-28d5-4b09-a310-370414e60929 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:58.414909 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1d5508e7-28d5-4b09-a310-370414e60929 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:58.424075 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d5508e7-28d5-4b09-a310-370414e60929 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:58.424852 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d5508e7-28d5-4b09-a310-370414e60929 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:58.425563 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d5508e7-28d5-4b09-a310-370414e60929 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:58.426265 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d5508e7-28d5-4b09-a310-370414e60929 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:58.426987 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d5508e7-28d5-4b09-a310-370414e60929 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:58.427121 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d5508e7-28d5-4b09-a310-370414e60929 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:58.623045 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1d5508e7-28d5-4b09-a310-370414e60929 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:58.633996 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1d5508e7-28d5-4b09-a310-370414e60929 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:58.635533 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1d5508e7-28d5-4b09-a310-370414e60929 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:58.638499 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1d5508e7-28d5-4b09-a310-370414e60929 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1736 microversion: 2.20 time: 0.228910 Oct 04 03:31:58.663034 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 170/337] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:58 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:31:58.928826 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c2a8d904-daeb-4a31-b5e7-5436c993cafe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:58.929364 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c2a8d904-daeb-4a31-b5e7-5436c993cafe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:58.938475 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c2a8d904-daeb-4a31-b5e7-5436c993cafe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:58.939167 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c2a8d904-daeb-4a31-b5e7-5436c993cafe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:58.939636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c2a8d904-daeb-4a31-b5e7-5436c993cafe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:58.940333 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c2a8d904-daeb-4a31-b5e7-5436c993cafe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:58.940775 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c2a8d904-daeb-4a31-b5e7-5436c993cafe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:58.941369 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c2a8d904-daeb-4a31-b5e7-5436c993cafe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:59.117842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c2a8d904-daeb-4a31-b5e7-5436c993cafe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:59.144855 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c2a8d904-daeb-4a31-b5e7-5436c993cafe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1371 microversion: 2.1 time: 0.222618 Oct 04 03:31:59.145826 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 168/338] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:58 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:59.374073 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-38ba7e51-196e-4db8-8467-318a1c12f295 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:59.381973 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-38ba7e51-196e-4db8-8467-318a1c12f295 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:59.394537 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-38ba7e51-196e-4db8-8467-318a1c12f295 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:59.395269 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-38ba7e51-196e-4db8-8467-318a1c12f295 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:59.395938 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-38ba7e51-196e-4db8-8467-318a1c12f295 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:59.398125 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-38ba7e51-196e-4db8-8467-318a1c12f295 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:59.399268 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-38ba7e51-196e-4db8-8467-318a1c12f295 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:59.400095 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-38ba7e51-196e-4db8-8467-318a1c12f295 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:59.503125 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-38ba7e51-196e-4db8-8467-318a1c12f295 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:31:59.513479 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-38ba7e51-196e-4db8-8467-318a1c12f295 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1277 microversion: 2.1 time: 0.143970 Oct 04 03:31:59.514050 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 171/339] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:31:59 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1277 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:31:59.673008 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-fb946513-9300-4141-89a8-84490e5ba7bf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:31:59.674208 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-fb946513-9300-4141-89a8-84490e5ba7bf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:31:59.701203 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fb946513-9300-4141-89a8-84490e5ba7bf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:59.701721 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fb946513-9300-4141-89a8-84490e5ba7bf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:59.702162 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fb946513-9300-4141-89a8-84490e5ba7bf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:31:59.703658 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fb946513-9300-4141-89a8-84490e5ba7bf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:31:59.704260 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fb946513-9300-4141-89a8-84490e5ba7bf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:31:59.705039 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fb946513-9300-4141-89a8-84490e5ba7bf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:00.184377 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c45c9b86-424c-4e4b-b4c5-f26d6c00868c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:00.185283 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c45c9b86-424c-4e4b-b4c5-f26d6c00868c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:00.188700 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:00.193480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c45c9b86-424c-4e4b-b4c5-f26d6c00868c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:00.194480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c45c9b86-424c-4e4b-b4c5-f26d6c00868c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:00.195765 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c45c9b86-424c-4e4b-b4c5-f26d6c00868c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:00.196788 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c45c9b86-424c-4e4b-b4c5-f26d6c00868c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:00.197528 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c45c9b86-424c-4e4b-b4c5-f26d6c00868c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:00.198272 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c45c9b86-424c-4e4b-b4c5-f26d6c00868c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:00.349150 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-fb946513-9300-4141-89a8-84490e5ba7bf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:00.362684 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-fb946513-9300-4141-89a8-84490e5ba7bf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:00.364576 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-fb946513-9300-4141-89a8-84490e5ba7bf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:00.367656 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-fb946513-9300-4141-89a8-84490e5ba7bf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1736 microversion: 2.20 time: 0.700685 Oct 04 03:32:00.382454 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 169/340] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:31:59 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1736 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:00.488857 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c45c9b86-424c-4e4b-b4c5-f26d6c00868c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:00.499305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c45c9b86-424c-4e4b-b4c5-f26d6c00868c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1371 microversion: 2.1 time: 0.318763 Oct 04 03:32:00.500270 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 172/341] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:00 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:00.540926 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b9f5a871-6725-44b9-a69a-7686ddaa638a tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:00.541540 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b9f5a871-6725-44b9-a69a-7686ddaa638a tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:00.549109 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b9f5a871-6725-44b9-a69a-7686ddaa638a tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:00.549602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b9f5a871-6725-44b9-a69a-7686ddaa638a tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:00.550035 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b9f5a871-6725-44b9-a69a-7686ddaa638a tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:00.560543 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b9f5a871-6725-44b9-a69a-7686ddaa638a tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:00.561279 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b9f5a871-6725-44b9-a69a-7686ddaa638a tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:00.561875 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b9f5a871-6725-44b9-a69a-7686ddaa638a tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:00.810278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b9f5a871-6725-44b9-a69a-7686ddaa638a tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:00.820896 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b9f5a871-6725-44b9-a69a-7686ddaa638a tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1319 microversion: 2.1 time: 0.283675 Oct 04 03:32:00.832222 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 170/342] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:00 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:01.446972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cc2df458-bac8-49d3-8f2a-50452901bb18 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:01.447926 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cc2df458-bac8-49d3-8f2a-50452901bb18 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:01.457453 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc2df458-bac8-49d3-8f2a-50452901bb18 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:01.460286 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc2df458-bac8-49d3-8f2a-50452901bb18 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:01.462513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc2df458-bac8-49d3-8f2a-50452901bb18 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:01.463526 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc2df458-bac8-49d3-8f2a-50452901bb18 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:01.465696 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc2df458-bac8-49d3-8f2a-50452901bb18 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:01.466308 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc2df458-bac8-49d3-8f2a-50452901bb18 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:01.526942 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-df3fbda9-8a5c-4365-b98a-ff51c386af04 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:01.527938 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-df3fbda9-8a5c-4365-b98a-ff51c386af04 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:01.553602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-df3fbda9-8a5c-4365-b98a-ff51c386af04 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:01.555138 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-df3fbda9-8a5c-4365-b98a-ff51c386af04 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:01.555707 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-df3fbda9-8a5c-4365-b98a-ff51c386af04 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:01.559604 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-df3fbda9-8a5c-4365-b98a-ff51c386af04 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:01.560029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-df3fbda9-8a5c-4365-b98a-ff51c386af04 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:01.564457 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-df3fbda9-8a5c-4365-b98a-ff51c386af04 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:01.868460 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-cc2df458-bac8-49d3-8f2a-50452901bb18 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:01.886727 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-cc2df458-bac8-49d3-8f2a-50452901bb18 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:01.888737 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-cc2df458-bac8-49d3-8f2a-50452901bb18 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:01.895951 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cc2df458-bac8-49d3-8f2a-50452901bb18 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1736 microversion: 2.20 time: 0.453781 Oct 04 03:32:01.898307 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 173/343] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:01 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1736 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:01.911061 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cfd98e22-ef80-4f6a-8c17-e768e72c5a35 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:01.913381 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cfd98e22-ef80-4f6a-8c17-e768e72c5a35 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:01.926652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cfd98e22-ef80-4f6a-8c17-e768e72c5a35 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:01.927286 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cfd98e22-ef80-4f6a-8c17-e768e72c5a35 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:01.928620 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cfd98e22-ef80-4f6a-8c17-e768e72c5a35 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:01.929480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cfd98e22-ef80-4f6a-8c17-e768e72c5a35 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:01.930230 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cfd98e22-ef80-4f6a-8c17-e768e72c5a35 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:01.931040 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cfd98e22-ef80-4f6a-8c17-e768e72c5a35 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:01.954203 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-df3fbda9-8a5c-4365-b98a-ff51c386af04 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:01.969094 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-df3fbda9-8a5c-4365-b98a-ff51c386af04 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1371 microversion: 2.1 time: 0.446317 Oct 04 03:32:01.970106 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 171/344] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:01 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1371 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:02.014116 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-9cd26e02-0b57-416f-9ff6-8bd508949ea2 req-2d75d23e-313d-456b-9793-f910c42c1168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fe86068-8683-468f-a300-d8b7bac8d2c1", "tag": "55936394-938d-4b9f-95f5-014c54fb58ab"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:02.030809 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-9cd26e02-0b57-416f-9ff6-8bd508949ea2 req-2d75d23e-313d-456b-9793-f910c42c1168 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:02.031668 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-9cd26e02-0b57-416f-9ff6-8bd508949ea2 req-2d75d23e-313d-456b-9793-f910c42c1168 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:02.032536 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-9cd26e02-0b57-416f-9ff6-8bd508949ea2 req-2d75d23e-313d-456b-9793-f910c42c1168 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:02.056699 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-9cd26e02-0b57-416f-9ff6-8bd508949ea2 req-2d75d23e-313d-456b-9793-f910c42c1168 service nova] Creating event network-changed:55936394-938d-4b9f-95f5-014c54fb58ab for instance 9fe86068-8683-468f-a300-d8b7bac8d2c1 on hv-cinder-84914 Oct 04 03:32:02.063117 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-9cd26e02-0b57-416f-9ff6-8bd508949ea2 req-2d75d23e-313d-456b-9793-f910c42c1168 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069717 Oct 04 03:32:02.064756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 172/345] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:32:02.104299 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-11e65c5a-6bd6-41dd-9573-9428f3e44111 req-8febee90-06ee-4460-aa9f-a8d3c8bed513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a2b849-4aeb-4b38-8204-9a1b6c3983d8", "name": "network-vif-plugged", "status": "completed", "tag": "c33a6354-d3b9-46e0-8da8-baff5c9a347a"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:02.119864 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-11e65c5a-6bd6-41dd-9573-9428f3e44111 req-8febee90-06ee-4460-aa9f-a8d3c8bed513 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:02.122333 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-11e65c5a-6bd6-41dd-9573-9428f3e44111 req-8febee90-06ee-4460-aa9f-a8d3c8bed513 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:02.122931 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-11e65c5a-6bd6-41dd-9573-9428f3e44111 req-8febee90-06ee-4460-aa9f-a8d3c8bed513 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:02.170034 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-11e65c5a-6bd6-41dd-9573-9428f3e44111 req-8febee90-06ee-4460-aa9f-a8d3c8bed513 service nova] Creating event network-vif-plugged:c33a6354-d3b9-46e0-8da8-baff5c9a347a for instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 on hv-cinder-84914 Oct 04 03:32:02.175331 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-11e65c5a-6bd6-41dd-9573-9428f3e44111 req-8febee90-06ee-4460-aa9f-a8d3c8bed513 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075439 Oct 04 03:32:02.176248 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 173/346] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:32:02.377373 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-cfd98e22-ef80-4f6a-8c17-e768e72c5a35 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:02.403394 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cfd98e22-ef80-4f6a-8c17-e768e72c5a35 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1319 microversion: 2.1 time: 0.502767 Oct 04 03:32:02.404298 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 174/347] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:01 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:02.926826 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-674fb94f-aadb-4865-9365-13b3c7574f37 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:02.928207 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-674fb94f-aadb-4865-9365-13b3c7574f37 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:02.934738 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-674fb94f-aadb-4865-9365-13b3c7574f37 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:02.935212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-674fb94f-aadb-4865-9365-13b3c7574f37 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:02.935674 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-674fb94f-aadb-4865-9365-13b3c7574f37 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:02.936355 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-674fb94f-aadb-4865-9365-13b3c7574f37 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:02.936799 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-674fb94f-aadb-4865-9365-13b3c7574f37 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:02.937217 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-674fb94f-aadb-4865-9365-13b3c7574f37 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:02.995750 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-30287fbb-3e3a-4d7a-90d9-444c716789ca tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:02.997258 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-30287fbb-3e3a-4d7a-90d9-444c716789ca tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:03.003756 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30287fbb-3e3a-4d7a-90d9-444c716789ca tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:03.004272 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30287fbb-3e3a-4d7a-90d9-444c716789ca tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:03.004706 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30287fbb-3e3a-4d7a-90d9-444c716789ca tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:03.005401 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30287fbb-3e3a-4d7a-90d9-444c716789ca tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:03.006394 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30287fbb-3e3a-4d7a-90d9-444c716789ca tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:03.006820 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30287fbb-3e3a-4d7a-90d9-444c716789ca tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:03.112173 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-674fb94f-aadb-4865-9365-13b3c7574f37 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:03.120422 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-674fb94f-aadb-4865-9365-13b3c7574f37 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:03.121850 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-674fb94f-aadb-4865-9365-13b3c7574f37 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:03.122997 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-674fb94f-aadb-4865-9365-13b3c7574f37 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1736 microversion: 2.20 time: 0.200455 Oct 04 03:32:03.123566 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 174/348] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:02 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:03.158886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-30287fbb-3e3a-4d7a-90d9-444c716789ca tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:03.167364 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-30287fbb-3e3a-4d7a-90d9-444c716789ca tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1371 microversion: 2.1 time: 0.175473 Oct 04 03:32:03.167948 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 175/349] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:02 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:32:03.430494 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9cb9695c-fb57-4db8-b46d-4fedf5e4dde1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:03.431502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-9cb9695c-fb57-4db8-b46d-4fedf5e4dde1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:03.437280 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9cb9695c-fb57-4db8-b46d-4fedf5e4dde1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:03.437760 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9cb9695c-fb57-4db8-b46d-4fedf5e4dde1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:03.438187 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9cb9695c-fb57-4db8-b46d-4fedf5e4dde1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:03.438861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9cb9695c-fb57-4db8-b46d-4fedf5e4dde1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:03.439305 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9cb9695c-fb57-4db8-b46d-4fedf5e4dde1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:03.439751 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9cb9695c-fb57-4db8-b46d-4fedf5e4dde1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:03.577893 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-9cb9695c-fb57-4db8-b46d-4fedf5e4dde1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:03.586153 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-9cb9695c-fb57-4db8-b46d-4fedf5e4dde1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1319 microversion: 2.1 time: 0.159812 Oct 04 03:32:03.586783 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 175/350] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:03 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:04.149062 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-25ca5f9a-ced4-47be-ab45-1cab8fd3b746 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:04.149688 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-25ca5f9a-ced4-47be-ab45-1cab8fd3b746 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:04.156038 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25ca5f9a-ced4-47be-ab45-1cab8fd3b746 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:04.156510 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25ca5f9a-ced4-47be-ab45-1cab8fd3b746 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:04.156933 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25ca5f9a-ced4-47be-ab45-1cab8fd3b746 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:04.157605 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25ca5f9a-ced4-47be-ab45-1cab8fd3b746 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:04.158048 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25ca5f9a-ced4-47be-ab45-1cab8fd3b746 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:04.158462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25ca5f9a-ced4-47be-ab45-1cab8fd3b746 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:04.190167 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2d9a15d6-6dc3-4eba-8a4a-95796dbc82b1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:04.190904 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-2d9a15d6-6dc3-4eba-8a4a-95796dbc82b1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:04.198063 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d9a15d6-6dc3-4eba-8a4a-95796dbc82b1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:04.198641 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d9a15d6-6dc3-4eba-8a4a-95796dbc82b1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:04.199148 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d9a15d6-6dc3-4eba-8a4a-95796dbc82b1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:04.199964 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d9a15d6-6dc3-4eba-8a4a-95796dbc82b1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:04.200484 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d9a15d6-6dc3-4eba-8a4a-95796dbc82b1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:04.200997 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d9a15d6-6dc3-4eba-8a4a-95796dbc82b1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:04.340472 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-25ca5f9a-ced4-47be-ab45-1cab8fd3b746 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:04.348461 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-25ca5f9a-ced4-47be-ab45-1cab8fd3b746 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:04.350079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-25ca5f9a-ced4-47be-ab45-1cab8fd3b746 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:04.352098 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-25ca5f9a-ced4-47be-ab45-1cab8fd3b746 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1736 microversion: 2.20 time: 0.207617 Oct 04 03:32:04.352733 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 176/351] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:04 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:04.371359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-2d9a15d6-6dc3-4eba-8a4a-95796dbc82b1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:04.378873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2d9a15d6-6dc3-4eba-8a4a-95796dbc82b1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1371 microversion: 2.1 time: 0.192549 Oct 04 03:32:04.379425 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 176/352] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:04 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:04.611436 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-60f7325e-2d03-48e5-87da-5986a717fec6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:04.611981 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-60f7325e-2d03-48e5-87da-5986a717fec6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:04.618434 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60f7325e-2d03-48e5-87da-5986a717fec6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:04.618913 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60f7325e-2d03-48e5-87da-5986a717fec6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:04.619350 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60f7325e-2d03-48e5-87da-5986a717fec6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:04.620063 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60f7325e-2d03-48e5-87da-5986a717fec6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:04.620515 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60f7325e-2d03-48e5-87da-5986a717fec6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:04.620928 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60f7325e-2d03-48e5-87da-5986a717fec6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:04.829223 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-60f7325e-2d03-48e5-87da-5986a717fec6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:04.836830 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-60f7325e-2d03-48e5-87da-5986a717fec6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1319 microversion: 2.1 time: 0.229398 Oct 04 03:32:04.837391 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 177/353] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:04 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:05.379448 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f8d9d847-0625-4337-9145-789f052805dc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:05.380249 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f8d9d847-0625-4337-9145-789f052805dc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:05.387753 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f8d9d847-0625-4337-9145-789f052805dc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:05.388233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f8d9d847-0625-4337-9145-789f052805dc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:05.388658 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f8d9d847-0625-4337-9145-789f052805dc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:05.389334 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f8d9d847-0625-4337-9145-789f052805dc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:05.389782 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f8d9d847-0625-4337-9145-789f052805dc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:05.390199 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f8d9d847-0625-4337-9145-789f052805dc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:05.402063 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5cb89f73-bca6-4324-8e93-6d1a7bf7db6a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:05.402678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5cb89f73-bca6-4324-8e93-6d1a7bf7db6a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:05.408980 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5cb89f73-bca6-4324-8e93-6d1a7bf7db6a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:05.409462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5cb89f73-bca6-4324-8e93-6d1a7bf7db6a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:05.409898 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5cb89f73-bca6-4324-8e93-6d1a7bf7db6a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:05.410589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5cb89f73-bca6-4324-8e93-6d1a7bf7db6a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:05.411042 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5cb89f73-bca6-4324-8e93-6d1a7bf7db6a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:05.411465 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5cb89f73-bca6-4324-8e93-6d1a7bf7db6a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:05.592960 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f8d9d847-0625-4337-9145-789f052805dc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:05.598044 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5cb89f73-bca6-4324-8e93-6d1a7bf7db6a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:05.605038 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f8d9d847-0625-4337-9145-789f052805dc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:05.606935 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f8d9d847-0625-4337-9145-789f052805dc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:05.608524 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5cb89f73-bca6-4324-8e93-6d1a7bf7db6a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1566 microversion: 2.1 time: 0.210401 Oct 04 03:32:05.609302 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 178/354] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:05 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1566 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:32:05.609439 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f8d9d847-0625-4337-9145-789f052805dc tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1718 microversion: 2.20 time: 0.235071 Oct 04 03:32:05.610347 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 177/355] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:05 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1718 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:05.631755 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b13eb005-b7af-4be3-8eaf-0205a46351cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:05.632168 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b13eb005-b7af-4be3-8eaf-0205a46351cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:05.640334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b13eb005-b7af-4be3-8eaf-0205a46351cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:05.640889 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b13eb005-b7af-4be3-8eaf-0205a46351cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:05.641327 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b13eb005-b7af-4be3-8eaf-0205a46351cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:05.642057 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b13eb005-b7af-4be3-8eaf-0205a46351cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:05.642509 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b13eb005-b7af-4be3-8eaf-0205a46351cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:05.642933 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b13eb005-b7af-4be3-8eaf-0205a46351cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:05.778191 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b13eb005-b7af-4be3-8eaf-0205a46351cd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150574 Oct 04 03:32:05.783855 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 179/356] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Oct 4 03:32:05 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:32:05.858293 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2bc0462f-d898-4da7-a895-f165b3080ac3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:05.859369 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-2bc0462f-d898-4da7-a895-f165b3080ac3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:05.877762 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2bc0462f-d898-4da7-a895-f165b3080ac3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:05.878673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2bc0462f-d898-4da7-a895-f165b3080ac3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:05.879360 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2bc0462f-d898-4da7-a895-f165b3080ac3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:05.880372 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2bc0462f-d898-4da7-a895-f165b3080ac3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:05.881068 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2bc0462f-d898-4da7-a895-f165b3080ac3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:05.881741 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2bc0462f-d898-4da7-a895-f165b3080ac3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:06.181261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-2bc0462f-d898-4da7-a895-f165b3080ac3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:06.190485 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2bc0462f-d898-4da7-a895-f165b3080ac3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1319 microversion: 2.1 time: 0.335991 Oct 04 03:32:06.197102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 178/357] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:05 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:06.635174 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e9a033e8-af93-4515-9dbf-cd587aa498e4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:06.636026 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e9a033e8-af93-4515-9dbf-cd587aa498e4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:06.642909 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e9a033e8-af93-4515-9dbf-cd587aa498e4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:06.643425 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e9a033e8-af93-4515-9dbf-cd587aa498e4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:06.644049 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e9a033e8-af93-4515-9dbf-cd587aa498e4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:06.644780 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e9a033e8-af93-4515-9dbf-cd587aa498e4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:06.645238 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e9a033e8-af93-4515-9dbf-cd587aa498e4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:06.645666 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e9a033e8-af93-4515-9dbf-cd587aa498e4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:06.773036 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:06.782065 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e9a033e8-af93-4515-9dbf-cd587aa498e4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:06.790682 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e9a033e8-af93-4515-9dbf-cd587aa498e4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:06.792251 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e9a033e8-af93-4515-9dbf-cd587aa498e4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:06.793466 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e9a033e8-af93-4515-9dbf-cd587aa498e4 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1718 microversion: 2.20 time: 0.163168 Oct 04 03:32:06.794102 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 180/358] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:06 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:07.027223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-550ad613-a184-4da2-af6f-281124bf023a req-7f02e6f1-9274-46a5-b41d-211f61c91bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36a2b849-4aeb-4b38-8204-9a1b6c3983d8", "tag": "c33a6354-d3b9-46e0-8da8-baff5c9a347a"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:07.037332 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-550ad613-a184-4da2-af6f-281124bf023a req-7f02e6f1-9274-46a5-b41d-211f61c91bb6 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:07.037798 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-550ad613-a184-4da2-af6f-281124bf023a req-7f02e6f1-9274-46a5-b41d-211f61c91bb6 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:07.038220 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-550ad613-a184-4da2-af6f-281124bf023a req-7f02e6f1-9274-46a5-b41d-211f61c91bb6 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:07.050114 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-550ad613-a184-4da2-af6f-281124bf023a req-7f02e6f1-9274-46a5-b41d-211f61c91bb6 service nova] Creating event network-changed:c33a6354-d3b9-46e0-8da8-baff5c9a347a for instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 on hv-cinder-84914 Oct 04 03:32:07.054841 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-550ad613-a184-4da2-af6f-281124bf023a req-7f02e6f1-9274-46a5-b41d-211f61c91bb6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031838 Oct 04 03:32:07.055420 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 179/359] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:32:07.214470 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a891dc7c-9c8e-41d8-b1e6-26d9dffbad20 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:07.215417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a891dc7c-9c8e-41d8-b1e6-26d9dffbad20 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:07.217578 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=10 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:07.223978 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a891dc7c-9c8e-41d8-b1e6-26d9dffbad20 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:07.224462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a891dc7c-9c8e-41d8-b1e6-26d9dffbad20 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:07.224885 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a891dc7c-9c8e-41d8-b1e6-26d9dffbad20 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:07.225573 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a891dc7c-9c8e-41d8-b1e6-26d9dffbad20 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:07.226012 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a891dc7c-9c8e-41d8-b1e6-26d9dffbad20 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:07.226420 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a891dc7c-9c8e-41d8-b1e6-26d9dffbad20 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:07.576093 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a891dc7c-9c8e-41d8-b1e6-26d9dffbad20 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:07.583606 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a891dc7c-9c8e-41d8-b1e6-26d9dffbad20 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1319 microversion: 2.1 time: 0.373604 Oct 04 03:32:07.584170 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 181/360] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:07 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:07.820456 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7a603628-7c99-4832-b0a7-39fd43526edf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:07.821686 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-7a603628-7c99-4832-b0a7-39fd43526edf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:07.827976 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a603628-7c99-4832-b0a7-39fd43526edf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:07.828468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a603628-7c99-4832-b0a7-39fd43526edf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:07.828908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a603628-7c99-4832-b0a7-39fd43526edf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:07.829620 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a603628-7c99-4832-b0a7-39fd43526edf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:07.830078 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a603628-7c99-4832-b0a7-39fd43526edf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:07.830502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a603628-7c99-4832-b0a7-39fd43526edf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:07.873263 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-07fb7c05-0e72-430c-a1f0-3d3b28d65ae2 req-417bad4c-82ab-427a-ad44-94b7c45d9e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe86068-8683-468f-a300-d8b7bac8d2c1", "name": "network-vif-plugged", "status": "completed", "tag": "55936394-938d-4b9f-95f5-014c54fb58ab"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:07.888457 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-07fb7c05-0e72-430c-a1f0-3d3b28d65ae2 req-417bad4c-82ab-427a-ad44-94b7c45d9e5b service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:07.889288 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-07fb7c05-0e72-430c-a1f0-3d3b28d65ae2 req-417bad4c-82ab-427a-ad44-94b7c45d9e5b service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:07.889982 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-07fb7c05-0e72-430c-a1f0-3d3b28d65ae2 req-417bad4c-82ab-427a-ad44-94b7c45d9e5b service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:07.896109 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:07.907821 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-07fb7c05-0e72-430c-a1f0-3d3b28d65ae2 req-417bad4c-82ab-427a-ad44-94b7c45d9e5b service nova] Creating event network-vif-plugged:55936394-938d-4b9f-95f5-014c54fb58ab for instance 9fe86068-8683-468f-a300-d8b7bac8d2c1 on hv-cinder-84914 Oct 04 03:32:07.913206 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-07fb7c05-0e72-430c-a1f0-3d3b28d65ae2 req-417bad4c-82ab-427a-ad44-94b7c45d9e5b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043678 Oct 04 03:32:07.914331 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 182/361] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:32:08.004528 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7a603628-7c99-4832-b0a7-39fd43526edf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:08.014816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7a603628-7c99-4832-b0a7-39fd43526edf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:08.016997 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7a603628-7c99-4832-b0a7-39fd43526edf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:08.018424 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-7a603628-7c99-4832-b0a7-39fd43526edf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1718 microversion: 2.20 time: 0.202553 Oct 04 03:32:08.019726 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 180/362] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:07 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1718 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:08.610549 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-34dd8d6d-a399-4ad1-893f-1f5f40daa581 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:08.611572 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-34dd8d6d-a399-4ad1-893f-1f5f40daa581 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:08.618821 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-34dd8d6d-a399-4ad1-893f-1f5f40daa581 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:08.619610 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-34dd8d6d-a399-4ad1-893f-1f5f40daa581 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:08.620206 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-34dd8d6d-a399-4ad1-893f-1f5f40daa581 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:08.621049 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-34dd8d6d-a399-4ad1-893f-1f5f40daa581 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:08.621643 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-34dd8d6d-a399-4ad1-893f-1f5f40daa581 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:08.622209 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-34dd8d6d-a399-4ad1-893f-1f5f40daa581 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:08.820879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-34dd8d6d-a399-4ad1-893f-1f5f40daa581 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:08.829197 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-34dd8d6d-a399-4ad1-893f-1f5f40daa581 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1319 microversion: 2.1 time: 0.223701 Oct 04 03:32:08.829782 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 183/363] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:08 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:32:09.046019 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-ce4d24a3-7671-4091-b20d-4e66e3d4549e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:09.046704 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-ce4d24a3-7671-4091-b20d-4e66e3d4549e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:09.053275 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ce4d24a3-7671-4091-b20d-4e66e3d4549e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:09.054114 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ce4d24a3-7671-4091-b20d-4e66e3d4549e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:09.054658 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ce4d24a3-7671-4091-b20d-4e66e3d4549e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:09.055456 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ce4d24a3-7671-4091-b20d-4e66e3d4549e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:09.055855 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ce4d24a3-7671-4091-b20d-4e66e3d4549e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:09.056274 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ce4d24a3-7671-4091-b20d-4e66e3d4549e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:09.239890 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-ce4d24a3-7671-4091-b20d-4e66e3d4549e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:09.248645 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-ce4d24a3-7671-4091-b20d-4e66e3d4549e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:09.250089 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-ce4d24a3-7671-4091-b20d-4e66e3d4549e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:09.251235 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-ce4d24a3-7671-4091-b20d-4e66e3d4549e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1721 microversion: 2.20 time: 0.209579 Oct 04 03:32:09.251813 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 181/364] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:09 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:09.276483 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-730b7805-a2ff-4953-ac92-22923afe1745 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9b002fe-8271-4ab7-8874-599782d72505"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:09.278907 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-730b7805-a2ff-4953-ac92-22923afe1745 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:09.285237 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-730b7805-a2ff-4953-ac92-22923afe1745 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:09.285720 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-730b7805-a2ff-4953-ac92-22923afe1745 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:09.286183 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-730b7805-a2ff-4953-ac92-22923afe1745 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:09.286848 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-730b7805-a2ff-4953-ac92-22923afe1745 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:09.287299 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-730b7805-a2ff-4953-ac92-22923afe1745 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:09.287749 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-730b7805-a2ff-4953-ac92-22923afe1745 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:09.578937 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-730b7805-a2ff-4953-ac92-22923afe1745 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "POST /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306409 Oct 04 03:32:09.579556 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 184/365] 10.222.0.25 () {62 vars in 1364 bytes} [Tue Oct 4 03:32:09 2022] POST /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:32:09.713684 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b0a60512-fc9c-4aed-9456-73a8f9d7d803 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:09.714288 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b0a60512-fc9c-4aed-9456-73a8f9d7d803 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:09.720613 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0a60512-fc9c-4aed-9456-73a8f9d7d803 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:09.720966 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0a60512-fc9c-4aed-9456-73a8f9d7d803 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:09.721401 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0a60512-fc9c-4aed-9456-73a8f9d7d803 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:09.722110 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0a60512-fc9c-4aed-9456-73a8f9d7d803 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:09.722558 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0a60512-fc9c-4aed-9456-73a8f9d7d803 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:09.722978 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0a60512-fc9c-4aed-9456-73a8f9d7d803 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:09.779088 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b0a60512-fc9c-4aed-9456-73a8f9d7d803 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120595) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 03:32:09.789855 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:09.852313 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fd9419a0-db32-4163-9ad4-8436705d5ce3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:09.853105 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-fd9419a0-db32-4163-9ad4-8436705d5ce3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:09.859889 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd9419a0-db32-4163-9ad4-8436705d5ce3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:09.860371 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd9419a0-db32-4163-9ad4-8436705d5ce3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:09.860799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd9419a0-db32-4163-9ad4-8436705d5ce3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:09.861479 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd9419a0-db32-4163-9ad4-8436705d5ce3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:09.861922 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd9419a0-db32-4163-9ad4-8436705d5ce3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:09.862341 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd9419a0-db32-4163-9ad4-8436705d5ce3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:09.867712 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b0a60512-fc9c-4aed-9456-73a8f9d7d803 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "POST /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/action" status: 202 len: 0 microversion: 2.20 time: 0.157342 Oct 04 03:32:09.867712 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 182/366] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Oct 4 03:32:09 2022] POST /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:32:09.877668 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e94f189b-d5bc-4885-96ef-bd20d6da720d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:09.878388 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e94f189b-d5bc-4885-96ef-bd20d6da720d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:09.886700 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e94f189b-d5bc-4885-96ef-bd20d6da720d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:09.887231 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e94f189b-d5bc-4885-96ef-bd20d6da720d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:09.887704 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e94f189b-d5bc-4885-96ef-bd20d6da720d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:09.888409 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e94f189b-d5bc-4885-96ef-bd20d6da720d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:09.888866 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e94f189b-d5bc-4885-96ef-bd20d6da720d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:09.889288 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e94f189b-d5bc-4885-96ef-bd20d6da720d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:10.109971 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-fd9419a0-db32-4163-9ad4-8436705d5ce3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:10.116457 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e94f189b-d5bc-4885-96ef-bd20d6da720d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:10.121312 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-fd9419a0-db32-4163-9ad4-8436705d5ce3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1319 microversion: 2.1 time: 0.273550 Oct 04 03:32:10.124048 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 185/367] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:09 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:32:10.126090 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e94f189b-d5bc-4885-96ef-bd20d6da720d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:10.128424 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-8cf1fd81-16d9-4c3c-b7b2-9b8817acd896 req-a55f42db-5d13-4c4c-a83d-9a4cede2731c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f680f852-0ad9-4478-912f-1821b7755927", "name": "network-vif-unplugged", "status": "completed", "tag": "b303180f-7432-4f63-b46d-6cc9c707c0d6"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:10.129681 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e94f189b-d5bc-4885-96ef-bd20d6da720d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:10.132259 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e94f189b-d5bc-4885-96ef-bd20d6da720d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1807 microversion: 2.20 time: 0.258946 Oct 04 03:32:10.133434 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 183/368] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:09 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1807 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:32:10.138797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-8cf1fd81-16d9-4c3c-b7b2-9b8817acd896 req-a55f42db-5d13-4c4c-a83d-9a4cede2731c service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:10.139276 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-8cf1fd81-16d9-4c3c-b7b2-9b8817acd896 req-a55f42db-5d13-4c4c-a83d-9a4cede2731c service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:10.139736 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-8cf1fd81-16d9-4c3c-b7b2-9b8817acd896 req-a55f42db-5d13-4c4c-a83d-9a4cede2731c service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:10.152457 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-8cf1fd81-16d9-4c3c-b7b2-9b8817acd896 req-a55f42db-5d13-4c4c-a83d-9a4cede2731c service nova] Creating event network-vif-unplugged:b303180f-7432-4f63-b46d-6cc9c707c0d6 for instance f680f852-0ad9-4478-912f-1821b7755927 on hv-cinder-84914 Oct 04 03:32:10.157594 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-8cf1fd81-16d9-4c3c-b7b2-9b8817acd896 req-a55f42db-5d13-4c4c-a83d-9a4cede2731c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033415 Oct 04 03:32:10.158448 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 186/369] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:32:11.145849 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-4f422c7e-fe74-42b4-9205-c5287c8e3ac5 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:11.146462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-4f422c7e-fe74-42b4-9205-c5287c8e3ac5 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:11.153056 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f422c7e-fe74-42b4-9205-c5287c8e3ac5 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:11.153444 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f422c7e-fe74-42b4-9205-c5287c8e3ac5 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:11.153882 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f422c7e-fe74-42b4-9205-c5287c8e3ac5 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:11.154643 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f422c7e-fe74-42b4-9205-c5287c8e3ac5 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:11.155056 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f422c7e-fe74-42b4-9205-c5287c8e3ac5 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:11.155720 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f422c7e-fe74-42b4-9205-c5287c8e3ac5 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:11.162533 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b9a67a4f-f5a7-4410-9ece-d13ede2e4dec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:11.163171 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b9a67a4f-f5a7-4410-9ece-d13ede2e4dec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:11.170203 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b9a67a4f-f5a7-4410-9ece-d13ede2e4dec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:11.170689 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b9a67a4f-f5a7-4410-9ece-d13ede2e4dec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:11.172473 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:11.173070 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b9a67a4f-f5a7-4410-9ece-d13ede2e4dec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:11.174075 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b9a67a4f-f5a7-4410-9ece-d13ede2e4dec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:11.174749 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b9a67a4f-f5a7-4410-9ece-d13ede2e4dec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:11.175502 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b9a67a4f-f5a7-4410-9ece-d13ede2e4dec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:11.378397 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4f422c7e-fe74-42b4-9205-c5287c8e3ac5 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:11.386776 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-4f422c7e-fe74-42b4-9205-c5287c8e3ac5 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1507 microversion: 2.1 time: 0.244653 Oct 04 03:32:11.387539 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 184/370] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:11 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:11.389720 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b9a67a4f-f5a7-4410-9ece-d13ede2e4dec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:11.398950 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b9a67a4f-f5a7-4410-9ece-d13ede2e4dec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:11.400421 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b9a67a4f-f5a7-4410-9ece-d13ede2e4dec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:11.401633 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b9a67a4f-f5a7-4410-9ece-d13ede2e4dec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1749 microversion: 2.20 time: 0.243976 Oct 04 03:32:11.402263 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 187/371] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:11 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1749 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:32:12.427960 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-234dc1a6-42b1-4a6f-8e54-ef94e61fe452 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:12.428464 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-234dc1a6-42b1-4a6f-8e54-ef94e61fe452 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:12.435544 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-234dc1a6-42b1-4a6f-8e54-ef94e61fe452 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:12.436023 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-234dc1a6-42b1-4a6f-8e54-ef94e61fe452 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:12.436452 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-234dc1a6-42b1-4a6f-8e54-ef94e61fe452 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:12.437126 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-234dc1a6-42b1-4a6f-8e54-ef94e61fe452 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:12.437570 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-234dc1a6-42b1-4a6f-8e54-ef94e61fe452 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:12.437984 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-234dc1a6-42b1-4a6f-8e54-ef94e61fe452 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:12.612788 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-234dc1a6-42b1-4a6f-8e54-ef94e61fe452 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:12.622522 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-234dc1a6-42b1-4a6f-8e54-ef94e61fe452 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:12.623999 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-234dc1a6-42b1-4a6f-8e54-ef94e61fe452 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:12.625171 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-234dc1a6-42b1-4a6f-8e54-ef94e61fe452 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.201189 Oct 04 03:32:12.625731 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 185/372] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:12 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:13.650824 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7e7cfc64-f7b1-4a14-9e42-bb7238745476 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:13.651193 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7e7cfc64-f7b1-4a14-9e42-bb7238745476 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:13.662617 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e7cfc64-f7b1-4a14-9e42-bb7238745476 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:13.663291 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e7cfc64-f7b1-4a14-9e42-bb7238745476 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:13.664389 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e7cfc64-f7b1-4a14-9e42-bb7238745476 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:13.665242 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e7cfc64-f7b1-4a14-9e42-bb7238745476 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:13.665893 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e7cfc64-f7b1-4a14-9e42-bb7238745476 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:13.666329 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e7cfc64-f7b1-4a14-9e42-bb7238745476 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:13.869988 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-7e7cfc64-f7b1-4a14-9e42-bb7238745476 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:13.879308 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-7e7cfc64-f7b1-4a14-9e42-bb7238745476 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:13.880809 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-7e7cfc64-f7b1-4a14-9e42-bb7238745476 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:13.881988 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7e7cfc64-f7b1-4a14-9e42-bb7238745476 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.235394 Oct 04 03:32:13.882595 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 188/373] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:13 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:14.909192 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-fb01b732-16dd-4cfe-831c-5b5ea9dbb2e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:14.909853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-fb01b732-16dd-4cfe-831c-5b5ea9dbb2e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:14.917318 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fb01b732-16dd-4cfe-831c-5b5ea9dbb2e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:14.917803 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fb01b732-16dd-4cfe-831c-5b5ea9dbb2e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:14.918240 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fb01b732-16dd-4cfe-831c-5b5ea9dbb2e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:14.918939 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fb01b732-16dd-4cfe-831c-5b5ea9dbb2e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:14.919382 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fb01b732-16dd-4cfe-831c-5b5ea9dbb2e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:14.919827 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fb01b732-16dd-4cfe-831c-5b5ea9dbb2e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:15.103440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-fb01b732-16dd-4cfe-831c-5b5ea9dbb2e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:15.112501 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-fb01b732-16dd-4cfe-831c-5b5ea9dbb2e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:15.113939 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-fb01b732-16dd-4cfe-831c-5b5ea9dbb2e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:15.115362 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-fb01b732-16dd-4cfe-831c-5b5ea9dbb2e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.210585 Oct 04 03:32:15.115954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 186/374] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:14 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:16.140897 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b7c0c399-5e2c-42b6-aee6-1a54cd3f4192 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:16.141822 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b7c0c399-5e2c-42b6-aee6-1a54cd3f4192 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:16.149188 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7c0c399-5e2c-42b6-aee6-1a54cd3f4192 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:16.149676 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7c0c399-5e2c-42b6-aee6-1a54cd3f4192 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:16.150111 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7c0c399-5e2c-42b6-aee6-1a54cd3f4192 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:16.150815 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7c0c399-5e2c-42b6-aee6-1a54cd3f4192 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:16.151262 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7c0c399-5e2c-42b6-aee6-1a54cd3f4192 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:16.151716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7c0c399-5e2c-42b6-aee6-1a54cd3f4192 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:16.288155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b7c0c399-5e2c-42b6-aee6-1a54cd3f4192 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:16.298972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b7c0c399-5e2c-42b6-aee6-1a54cd3f4192 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:16.300458 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b7c0c399-5e2c-42b6-aee6-1a54cd3f4192 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:16.301651 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b7c0c399-5e2c-42b6-aee6-1a54cd3f4192 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.164744 Oct 04 03:32:16.302211 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 189/375] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:16 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:17.335345 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-37c7c9d8-09d0-466f-b6df-6240664868f5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:17.336220 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-37c7c9d8-09d0-466f-b6df-6240664868f5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:17.345270 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-37c7c9d8-09d0-466f-b6df-6240664868f5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:17.345758 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-37c7c9d8-09d0-466f-b6df-6240664868f5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:17.346190 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-37c7c9d8-09d0-466f-b6df-6240664868f5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:17.346890 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-37c7c9d8-09d0-466f-b6df-6240664868f5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:17.347342 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-37c7c9d8-09d0-466f-b6df-6240664868f5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:17.347865 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-37c7c9d8-09d0-466f-b6df-6240664868f5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:17.497251 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-37c7c9d8-09d0-466f-b6df-6240664868f5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:17.505961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-37c7c9d8-09d0-466f-b6df-6240664868f5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:17.507439 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-37c7c9d8-09d0-466f-b6df-6240664868f5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:17.509600 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-37c7c9d8-09d0-466f-b6df-6240664868f5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.184819 Oct 04 03:32:17.509600 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 187/376] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:17 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:18.534357 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6a123421-5b21-450d-8105-56f6d2e0e332 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:18.534968 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6a123421-5b21-450d-8105-56f6d2e0e332 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:18.542174 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a123421-5b21-450d-8105-56f6d2e0e332 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:18.542656 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a123421-5b21-450d-8105-56f6d2e0e332 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:18.543093 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a123421-5b21-450d-8105-56f6d2e0e332 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:18.543813 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a123421-5b21-450d-8105-56f6d2e0e332 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:18.544268 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a123421-5b21-450d-8105-56f6d2e0e332 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:18.544693 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a123421-5b21-450d-8105-56f6d2e0e332 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:18.693901 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6a123421-5b21-450d-8105-56f6d2e0e332 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:18.703964 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6a123421-5b21-450d-8105-56f6d2e0e332 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:18.705399 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6a123421-5b21-450d-8105-56f6d2e0e332 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:18.706570 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6a123421-5b21-450d-8105-56f6d2e0e332 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.176232 Oct 04 03:32:18.707125 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 190/377] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:18 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:32:19.736082 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-994a8c2e-349a-4018-9e29-3629145f7107 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:19.736974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-994a8c2e-349a-4018-9e29-3629145f7107 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:19.758215 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-994a8c2e-349a-4018-9e29-3629145f7107 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:19.758989 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-994a8c2e-349a-4018-9e29-3629145f7107 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:19.759604 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-994a8c2e-349a-4018-9e29-3629145f7107 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:19.760489 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-994a8c2e-349a-4018-9e29-3629145f7107 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:19.761096 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-994a8c2e-349a-4018-9e29-3629145f7107 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:19.761672 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-994a8c2e-349a-4018-9e29-3629145f7107 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:19.919251 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-994a8c2e-349a-4018-9e29-3629145f7107 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:19.929423 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-994a8c2e-349a-4018-9e29-3629145f7107 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:19.932377 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-994a8c2e-349a-4018-9e29-3629145f7107 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:19.933607 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-994a8c2e-349a-4018-9e29-3629145f7107 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.202791 Oct 04 03:32:19.934203 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 188/378] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:19 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:20.961129 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1b2cba6d-d765-45aa-a969-b096f1afdd02 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:20.962802 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1b2cba6d-d765-45aa-a969-b096f1afdd02 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:20.969608 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1b2cba6d-d765-45aa-a969-b096f1afdd02 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:20.970092 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1b2cba6d-d765-45aa-a969-b096f1afdd02 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:20.970519 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1b2cba6d-d765-45aa-a969-b096f1afdd02 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:20.971433 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1b2cba6d-d765-45aa-a969-b096f1afdd02 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:20.971899 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1b2cba6d-d765-45aa-a969-b096f1afdd02 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:20.972491 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1b2cba6d-d765-45aa-a969-b096f1afdd02 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:21.138939 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1b2cba6d-d765-45aa-a969-b096f1afdd02 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:21.148566 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1b2cba6d-d765-45aa-a969-b096f1afdd02 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:21.151674 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1b2cba6d-d765-45aa-a969-b096f1afdd02 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:21.153113 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1b2cba6d-d765-45aa-a969-b096f1afdd02 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.197597 Oct 04 03:32:21.160911 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 191/379] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:20 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:22.184079 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b5d899a1-b717-4b45-8bd9-fbc74e878e3f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:22.185163 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b5d899a1-b717-4b45-8bd9-fbc74e878e3f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:22.194747 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b5d899a1-b717-4b45-8bd9-fbc74e878e3f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:22.195230 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b5d899a1-b717-4b45-8bd9-fbc74e878e3f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:22.195707 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b5d899a1-b717-4b45-8bd9-fbc74e878e3f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:22.197058 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b5d899a1-b717-4b45-8bd9-fbc74e878e3f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:22.197507 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b5d899a1-b717-4b45-8bd9-fbc74e878e3f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:22.198100 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b5d899a1-b717-4b45-8bd9-fbc74e878e3f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:22.329664 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b5d899a1-b717-4b45-8bd9-fbc74e878e3f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:22.338568 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b5d899a1-b717-4b45-8bd9-fbc74e878e3f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:22.340059 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b5d899a1-b717-4b45-8bd9-fbc74e878e3f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:22.341200 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b5d899a1-b717-4b45-8bd9-fbc74e878e3f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.162771 Oct 04 03:32:22.341758 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 189/380] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:22 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:32:23.367212 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-66c2be8b-64aa-44f5-91f9-badd1c61bc7d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:23.368003 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-66c2be8b-64aa-44f5-91f9-badd1c61bc7d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:23.374135 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66c2be8b-64aa-44f5-91f9-badd1c61bc7d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:23.374617 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66c2be8b-64aa-44f5-91f9-badd1c61bc7d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:23.375047 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66c2be8b-64aa-44f5-91f9-badd1c61bc7d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:23.375780 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66c2be8b-64aa-44f5-91f9-badd1c61bc7d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:23.376234 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66c2be8b-64aa-44f5-91f9-badd1c61bc7d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:23.376653 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66c2be8b-64aa-44f5-91f9-badd1c61bc7d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:23.517910 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-66c2be8b-64aa-44f5-91f9-badd1c61bc7d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:23.527442 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-66c2be8b-64aa-44f5-91f9-badd1c61bc7d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:23.528893 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-66c2be8b-64aa-44f5-91f9-badd1c61bc7d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:23.530046 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-66c2be8b-64aa-44f5-91f9-badd1c61bc7d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.166888 Oct 04 03:32:23.530628 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 192/381] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:23 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:24.556463 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-fdecf262-dcdb-445b-b77d-787b729c05e7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:24.558056 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-fdecf262-dcdb-445b-b77d-787b729c05e7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:24.565158 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fdecf262-dcdb-445b-b77d-787b729c05e7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:24.566578 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fdecf262-dcdb-445b-b77d-787b729c05e7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:24.567219 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fdecf262-dcdb-445b-b77d-787b729c05e7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:24.568579 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fdecf262-dcdb-445b-b77d-787b729c05e7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:24.569248 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fdecf262-dcdb-445b-b77d-787b729c05e7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:24.569861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fdecf262-dcdb-445b-b77d-787b729c05e7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:24.777829 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-fdecf262-dcdb-445b-b77d-787b729c05e7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:24.788511 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-fdecf262-dcdb-445b-b77d-787b729c05e7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:24.790877 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-fdecf262-dcdb-445b-b77d-787b729c05e7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:24.792035 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-fdecf262-dcdb-445b-b77d-787b729c05e7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.240350 Oct 04 03:32:24.792752 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 190/382] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:24 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:25.819545 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-aa885729-dd16-4ce5-9937-02f23b7322b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:25.820176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-aa885729-dd16-4ce5-9937-02f23b7322b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:25.831363 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aa885729-dd16-4ce5-9937-02f23b7322b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:25.832138 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aa885729-dd16-4ce5-9937-02f23b7322b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:25.832742 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aa885729-dd16-4ce5-9937-02f23b7322b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:25.836174 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aa885729-dd16-4ce5-9937-02f23b7322b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:25.837336 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aa885729-dd16-4ce5-9937-02f23b7322b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:25.838165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aa885729-dd16-4ce5-9937-02f23b7322b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:25.983573 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-aa885729-dd16-4ce5-9937-02f23b7322b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:25.992076 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-aa885729-dd16-4ce5-9937-02f23b7322b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:25.993736 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-aa885729-dd16-4ce5-9937-02f23b7322b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:25.994872 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-aa885729-dd16-4ce5-9937-02f23b7322b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.179799 Oct 04 03:32:25.995419 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 193/383] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:25 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:32:27.020481 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7fe8e9c9-9298-4320-b873-2abc5f6d2b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:27.021082 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-7fe8e9c9-9298-4320-b873-2abc5f6d2b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:27.027856 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7fe8e9c9-9298-4320-b873-2abc5f6d2b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:27.028336 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7fe8e9c9-9298-4320-b873-2abc5f6d2b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:27.028766 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7fe8e9c9-9298-4320-b873-2abc5f6d2b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:27.029452 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7fe8e9c9-9298-4320-b873-2abc5f6d2b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:27.029901 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7fe8e9c9-9298-4320-b873-2abc5f6d2b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:27.030323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7fe8e9c9-9298-4320-b873-2abc5f6d2b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:27.162010 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7fe8e9c9-9298-4320-b873-2abc5f6d2b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:27.172015 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7fe8e9c9-9298-4320-b873-2abc5f6d2b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:27.173502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7fe8e9c9-9298-4320-b873-2abc5f6d2b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:27.174646 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-7fe8e9c9-9298-4320-b873-2abc5f6d2b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.158094 Oct 04 03:32:27.175238 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 191/384] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:27 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:28.201713 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-eee5feb9-59cf-466c-98ac-e5703922b292 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:28.202341 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-eee5feb9-59cf-466c-98ac-e5703922b292 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:28.208788 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eee5feb9-59cf-466c-98ac-e5703922b292 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:28.209261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eee5feb9-59cf-466c-98ac-e5703922b292 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:28.209680 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eee5feb9-59cf-466c-98ac-e5703922b292 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:28.210354 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eee5feb9-59cf-466c-98ac-e5703922b292 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:28.210792 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eee5feb9-59cf-466c-98ac-e5703922b292 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:28.211203 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eee5feb9-59cf-466c-98ac-e5703922b292 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:28.336252 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-eee5feb9-59cf-466c-98ac-e5703922b292 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:28.345011 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-eee5feb9-59cf-466c-98ac-e5703922b292 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:28.346450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-eee5feb9-59cf-466c-98ac-e5703922b292 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:28.347621 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-eee5feb9-59cf-466c-98ac-e5703922b292 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.149838 Oct 04 03:32:28.348170 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 194/385] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:28 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:29.374262 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-8df5af94-55ec-4ef6-9ccb-60e4c60785a9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:29.374887 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-8df5af94-55ec-4ef6-9ccb-60e4c60785a9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:29.380820 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8df5af94-55ec-4ef6-9ccb-60e4c60785a9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:29.381297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8df5af94-55ec-4ef6-9ccb-60e4c60785a9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:29.381728 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8df5af94-55ec-4ef6-9ccb-60e4c60785a9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:29.382409 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8df5af94-55ec-4ef6-9ccb-60e4c60785a9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:29.382856 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8df5af94-55ec-4ef6-9ccb-60e4c60785a9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:29.383873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8df5af94-55ec-4ef6-9ccb-60e4c60785a9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:29.515578 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-8df5af94-55ec-4ef6-9ccb-60e4c60785a9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:29.524176 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-8df5af94-55ec-4ef6-9ccb-60e4c60785a9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:29.525597 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-8df5af94-55ec-4ef6-9ccb-60e4c60785a9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:29.526734 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-8df5af94-55ec-4ef6-9ccb-60e4c60785a9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.156612 Oct 04 03:32:29.527291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 192/386] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:29 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:30.552959 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b8233108-27ac-44d0-9483-7fed5d7438d1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:30.553558 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b8233108-27ac-44d0-9483-7fed5d7438d1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:30.556727 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=46 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:30.561991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8233108-27ac-44d0-9483-7fed5d7438d1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:30.562466 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8233108-27ac-44d0-9483-7fed5d7438d1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:30.562891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8233108-27ac-44d0-9483-7fed5d7438d1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:30.563597 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8233108-27ac-44d0-9483-7fed5d7438d1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:30.564042 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8233108-27ac-44d0-9483-7fed5d7438d1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:30.564456 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8233108-27ac-44d0-9483-7fed5d7438d1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:30.696399 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b8233108-27ac-44d0-9483-7fed5d7438d1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:30.704819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b8233108-27ac-44d0-9483-7fed5d7438d1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:30.706235 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b8233108-27ac-44d0-9483-7fed5d7438d1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:30.707377 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b8233108-27ac-44d0-9483-7fed5d7438d1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.158344 Oct 04 03:32:30.707949 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 195/387] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:30 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:30.971310 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a03b646c-b68d-46e4-9fe7-d77f9a603eb1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f286035-7fde-4ab0-8864-edd54fdff1ff", "device": "/dev/sdb"}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:30.974251 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a03b646c-b68d-46e4-9fe7-d77f9a603eb1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:30.981824 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a03b646c-b68d-46e4-9fe7-d77f9a603eb1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:30.982304 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a03b646c-b68d-46e4-9fe7-d77f9a603eb1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:30.982735 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a03b646c-b68d-46e4-9fe7-d77f9a603eb1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:30.983415 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a03b646c-b68d-46e4-9fe7-d77f9a603eb1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:30.983887 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a03b646c-b68d-46e4-9fe7-d77f9a603eb1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:30.984306 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a03b646c-b68d-46e4-9fe7-d77f9a603eb1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:31.239617 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a03b646c-b68d-46e4-9fe7-d77f9a603eb1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "POST /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271966 Oct 04 03:32:31.240218 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 193/388] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Oct 4 03:32:30 2022] POST /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:32:31.733160 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ff9094c4-d670-43b6-ab29-aa37d2216346 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:31.733875 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ff9094c4-d670-43b6-ab29-aa37d2216346 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:31.740184 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff9094c4-d670-43b6-ab29-aa37d2216346 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:31.740657 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff9094c4-d670-43b6-ab29-aa37d2216346 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:31.741083 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff9094c4-d670-43b6-ab29-aa37d2216346 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:31.741768 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff9094c4-d670-43b6-ab29-aa37d2216346 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:31.742210 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff9094c4-d670-43b6-ab29-aa37d2216346 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:31.742685 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff9094c4-d670-43b6-ab29-aa37d2216346 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:31.873129 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ff9094c4-d670-43b6-ab29-aa37d2216346 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:31.881648 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ff9094c4-d670-43b6-ab29-aa37d2216346 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:31.883178 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ff9094c4-d670-43b6-ab29-aa37d2216346 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:31.884418 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ff9094c4-d670-43b6-ab29-aa37d2216346 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.155301 Oct 04 03:32:31.884969 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 196/389] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:31 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:32.911218 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c1428bee-7d42-4448-823e-dd33f1ec2a09 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:32.911856 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c1428bee-7d42-4448-823e-dd33f1ec2a09 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:32.918636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1428bee-7d42-4448-823e-dd33f1ec2a09 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:32.919119 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1428bee-7d42-4448-823e-dd33f1ec2a09 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:32.919584 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1428bee-7d42-4448-823e-dd33f1ec2a09 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:32.920274 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1428bee-7d42-4448-823e-dd33f1ec2a09 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:32.920728 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1428bee-7d42-4448-823e-dd33f1ec2a09 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:32.921148 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1428bee-7d42-4448-823e-dd33f1ec2a09 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:33.048270 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c1428bee-7d42-4448-823e-dd33f1ec2a09 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:33.057726 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c1428bee-7d42-4448-823e-dd33f1ec2a09 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:33.059160 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c1428bee-7d42-4448-823e-dd33f1ec2a09 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:33.060354 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c1428bee-7d42-4448-823e-dd33f1ec2a09 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.153934 Oct 04 03:32:33.060905 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 194/390] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:32 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:33.910678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-d8672f47-6191-4296-a052-90da7248c692 req-78f87505-9fff-4ca4-9892-bfea3fbe0747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f680f852-0ad9-4478-912f-1821b7755927", "name": "network-vif-plugged", "status": "completed", "tag": "b303180f-7432-4f63-b46d-6cc9c707c0d6"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:33.920734 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d8672f47-6191-4296-a052-90da7248c692 req-78f87505-9fff-4ca4-9892-bfea3fbe0747 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:33.921218 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d8672f47-6191-4296-a052-90da7248c692 req-78f87505-9fff-4ca4-9892-bfea3fbe0747 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:33.921648 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d8672f47-6191-4296-a052-90da7248c692 req-78f87505-9fff-4ca4-9892-bfea3fbe0747 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:33.933626 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-d8672f47-6191-4296-a052-90da7248c692 req-78f87505-9fff-4ca4-9892-bfea3fbe0747 service nova] Creating event network-vif-plugged:b303180f-7432-4f63-b46d-6cc9c707c0d6 for instance f680f852-0ad9-4478-912f-1821b7755927 on hv-cinder-84914 Oct 04 03:32:33.938463 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-d8672f47-6191-4296-a052-90da7248c692 req-78f87505-9fff-4ca4-9892-bfea3fbe0747 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031591 Oct 04 03:32:33.939365 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 197/391] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:32:34.086063 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-79105c4f-71aa-4b01-99d4-5a8001a263e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:34.087513 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-79105c4f-71aa-4b01-99d4-5a8001a263e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:34.093909 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79105c4f-71aa-4b01-99d4-5a8001a263e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:34.094412 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79105c4f-71aa-4b01-99d4-5a8001a263e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:34.094820 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79105c4f-71aa-4b01-99d4-5a8001a263e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:34.095516 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79105c4f-71aa-4b01-99d4-5a8001a263e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:34.095970 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79105c4f-71aa-4b01-99d4-5a8001a263e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:34.096390 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79105c4f-71aa-4b01-99d4-5a8001a263e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:34.231058 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-79105c4f-71aa-4b01-99d4-5a8001a263e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:34.239534 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-79105c4f-71aa-4b01-99d4-5a8001a263e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:34.241133 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-79105c4f-71aa-4b01-99d4-5a8001a263e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:34.242284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-79105c4f-71aa-4b01-99d4-5a8001a263e0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.160130 Oct 04 03:32:34.242945 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 195/392] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:34 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:34.282819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-c59bda01-849e-4999-8e82-fa93ad861b51 req-08c15003-a81e-4287-866c-ae60a6e50f9f admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "6f286035-7fde-4ab0-8864-edd54fdff1ff", "create_info": {"type": "qcow2", "new_file": "volume-6f286035-7fde-4ab0-8864-edd54fdff1ff.d0599feb-9d07-4c46-b076-cb2e4dfa8731.vhdx", "snapshot_id": "d0599feb-9d07-4c46-b076-cb2e4dfa8731"}}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:34.292015 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [req-c59bda01-849e-4999-8e82-fa93ad861b51 req-08c15003-a81e-4287-866c-ae60a6e50f9f admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c793cbfa-d3d2-4516-ac60-2697c5f19478(cell1) {{(pid=120594) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 03:32:34.292465 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c59bda01-849e-4999-8e82-fa93ad861b51 req-08c15003-a81e-4287-866c-ae60a6e50f9f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:34.292933 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c59bda01-849e-4999-8e82-fa93ad861b51 req-08c15003-a81e-4287-866c-ae60a6e50f9f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:34.293355 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c59bda01-849e-4999-8e82-fa93ad861b51 req-08c15003-a81e-4287-866c-ae60a6e50f9f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:34.332802 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c59bda01-849e-4999-8e82-fa93ad861b51 req-08c15003-a81e-4287-866c-ae60a6e50f9f admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:34.333272 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c59bda01-849e-4999-8e82-fa93ad861b51 req-08c15003-a81e-4287-866c-ae60a6e50f9f admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:34.333698 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c59bda01-849e-4999-8e82-fa93ad861b51 req-08c15003-a81e-4287-866c-ae60a6e50f9f admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:34.345106 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:34.357759 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-c59bda01-849e-4999-8e82-fa93ad861b51 req-08c15003-a81e-4287-866c-ae60a6e50f9f admin admin] 10.222.0.33 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.189854 Oct 04 03:32:34.358344 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 198/393] 10.222.0.33 () {64 vars in 1326 bytes} [Tue Oct 4 03:32:34 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 03:32:35.267783 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6a332fde-3741-41f2-a148-df4f71687fe9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:35.268407 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6a332fde-3741-41f2-a148-df4f71687fe9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:35.274856 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6a332fde-3741-41f2-a148-df4f71687fe9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:35.275329 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6a332fde-3741-41f2-a148-df4f71687fe9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:35.275791 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6a332fde-3741-41f2-a148-df4f71687fe9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:35.276471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6a332fde-3741-41f2-a148-df4f71687fe9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:35.276913 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6a332fde-3741-41f2-a148-df4f71687fe9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:35.277327 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6a332fde-3741-41f2-a148-df4f71687fe9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:35.493497 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6a332fde-3741-41f2-a148-df4f71687fe9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:35.502029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6a332fde-3741-41f2-a148-df4f71687fe9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:35.503464 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6a332fde-3741-41f2-a148-df4f71687fe9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:35.504630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6a332fde-3741-41f2-a148-df4f71687fe9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.240755 Oct 04 03:32:35.505185 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 196/394] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:35 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:36.532513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1f93b417-e75d-4aea-b41e-7e91a0cd1a2b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:36.533215 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1f93b417-e75d-4aea-b41e-7e91a0cd1a2b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:36.541406 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1f93b417-e75d-4aea-b41e-7e91a0cd1a2b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:36.541897 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1f93b417-e75d-4aea-b41e-7e91a0cd1a2b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:36.542358 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1f93b417-e75d-4aea-b41e-7e91a0cd1a2b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:36.543055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1f93b417-e75d-4aea-b41e-7e91a0cd1a2b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:36.543530 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1f93b417-e75d-4aea-b41e-7e91a0cd1a2b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:36.543954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1f93b417-e75d-4aea-b41e-7e91a0cd1a2b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:36.705826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1f93b417-e75d-4aea-b41e-7e91a0cd1a2b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:36.714687 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1f93b417-e75d-4aea-b41e-7e91a0cd1a2b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:36.716182 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1f93b417-e75d-4aea-b41e-7e91a0cd1a2b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:36.717340 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1f93b417-e75d-4aea-b41e-7e91a0cd1a2b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.190011 Oct 04 03:32:36.717897 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 199/395] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:36 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:37.743309 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7a28c6fe-4bc0-4e0e-b529-ad49ea7f115f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:37.744597 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-7a28c6fe-4bc0-4e0e-b529-ad49ea7f115f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:37.751271 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a28c6fe-4bc0-4e0e-b529-ad49ea7f115f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:37.752045 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a28c6fe-4bc0-4e0e-b529-ad49ea7f115f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:37.752475 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a28c6fe-4bc0-4e0e-b529-ad49ea7f115f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:37.753089 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a28c6fe-4bc0-4e0e-b529-ad49ea7f115f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:37.753536 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a28c6fe-4bc0-4e0e-b529-ad49ea7f115f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:37.753955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a28c6fe-4bc0-4e0e-b529-ad49ea7f115f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:37.897980 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7a28c6fe-4bc0-4e0e-b529-ad49ea7f115f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:37.907975 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7a28c6fe-4bc0-4e0e-b529-ad49ea7f115f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:37.909632 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7a28c6fe-4bc0-4e0e-b529-ad49ea7f115f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:37.911027 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-7a28c6fe-4bc0-4e0e-b529-ad49ea7f115f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1805 microversion: 2.20 time: 0.171295 Oct 04 03:32:37.911628 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 197/396] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:37 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1805 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:32:38.193603 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-ce478d83-82a9-4f2c-8043-97e31bfc3a61 req-bd52b3b6-fac5-486a-b95e-747bd85bb92a admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "6f286035-7fde-4ab0-8864-edd54fdff1ff", "create_info": {"type": "qcow2", "new_file": "volume-6f286035-7fde-4ab0-8864-edd54fdff1ff.436e8f16-cb14-4bb8-84ee-12170844400f.vhdx", "snapshot_id": "436e8f16-cb14-4bb8-84ee-12170844400f"}}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:38.198110 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ce478d83-82a9-4f2c-8043-97e31bfc3a61 req-bd52b3b6-fac5-486a-b95e-747bd85bb92a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:38.199237 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ce478d83-82a9-4f2c-8043-97e31bfc3a61 req-bd52b3b6-fac5-486a-b95e-747bd85bb92a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:38.199711 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ce478d83-82a9-4f2c-8043-97e31bfc3a61 req-bd52b3b6-fac5-486a-b95e-747bd85bb92a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:38.209203 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ce478d83-82a9-4f2c-8043-97e31bfc3a61 req-bd52b3b6-fac5-486a-b95e-747bd85bb92a admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:38.209671 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ce478d83-82a9-4f2c-8043-97e31bfc3a61 req-bd52b3b6-fac5-486a-b95e-747bd85bb92a admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:38.210091 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ce478d83-82a9-4f2c-8043-97e31bfc3a61 req-bd52b3b6-fac5-486a-b95e-747bd85bb92a admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:38.223537 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-ce478d83-82a9-4f2c-8043-97e31bfc3a61 req-bd52b3b6-fac5-486a-b95e-747bd85bb92a admin admin] 10.222.0.33 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.086118 Oct 04 03:32:38.224130 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 200/397] 10.222.0.33 () {64 vars in 1326 bytes} [Tue Oct 4 03:32:38 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 03:32:38.938623 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d401714a-b6a4-40ac-b0c3-824025b5870a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:38.939159 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d401714a-b6a4-40ac-b0c3-824025b5870a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:38.945738 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d401714a-b6a4-40ac-b0c3-824025b5870a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:38.946213 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d401714a-b6a4-40ac-b0c3-824025b5870a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:38.946691 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d401714a-b6a4-40ac-b0c3-824025b5870a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:38.947467 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d401714a-b6a4-40ac-b0c3-824025b5870a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:38.947934 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d401714a-b6a4-40ac-b0c3-824025b5870a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:38.948352 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d401714a-b6a4-40ac-b0c3-824025b5870a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:39.085112 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d401714a-b6a4-40ac-b0c3-824025b5870a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:39.093843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d401714a-b6a4-40ac-b0c3-824025b5870a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:39.095257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d401714a-b6a4-40ac-b0c3-824025b5870a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:39.096417 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d401714a-b6a4-40ac-b0c3-824025b5870a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1792 microversion: 2.20 time: 0.161747 Oct 04 03:32:39.096953 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 198/398] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:32:38 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1792 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:32:42.463611 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-c284e61f-9cb9-435e-9d57-811935e5800d req-a49b36ca-5260-4043-9f95-0239d3d36dac admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "6f286035-7fde-4ab0-8864-edd54fdff1ff", "create_info": {"type": "qcow2", "new_file": "volume-6f286035-7fde-4ab0-8864-edd54fdff1ff.78e0c03b-d9a0-414e-adb5-b8d9a150f821.vhdx", "snapshot_id": "78e0c03b-d9a0-414e-adb5-b8d9a150f821"}}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:42.466854 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c284e61f-9cb9-435e-9d57-811935e5800d req-a49b36ca-5260-4043-9f95-0239d3d36dac admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:42.467316 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c284e61f-9cb9-435e-9d57-811935e5800d req-a49b36ca-5260-4043-9f95-0239d3d36dac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:42.467771 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c284e61f-9cb9-435e-9d57-811935e5800d req-a49b36ca-5260-4043-9f95-0239d3d36dac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:42.475909 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c284e61f-9cb9-435e-9d57-811935e5800d req-a49b36ca-5260-4043-9f95-0239d3d36dac admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:42.476376 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c284e61f-9cb9-435e-9d57-811935e5800d req-a49b36ca-5260-4043-9f95-0239d3d36dac admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:42.476803 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c284e61f-9cb9-435e-9d57-811935e5800d req-a49b36ca-5260-4043-9f95-0239d3d36dac admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:42.490242 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-c284e61f-9cb9-435e-9d57-811935e5800d req-a49b36ca-5260-4043-9f95-0239d3d36dac admin admin] 10.222.0.33 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.079819 Oct 04 03:32:42.490825 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 201/399] 10.222.0.33 () {64 vars in 1326 bytes} [Tue Oct 4 03:32:42 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 03:32:45.582005 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-cb2771ef-56b4-4187-b90b-12c8217aaf0e req-ba5e4587-7fc3-40f8-9c4a-f899f7061e02 admin admin] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:45.586512 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:45.592167 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [req-cb2771ef-56b4-4187-b90b-12c8217aaf0e req-ba5e4587-7fc3-40f8-9c4a-f899f7061e02 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c793cbfa-d3d2-4516-ac60-2697c5f19478(cell1) {{(pid=120595) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 03:32:45.592612 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-cb2771ef-56b4-4187-b90b-12c8217aaf0e req-ba5e4587-7fc3-40f8-9c4a-f899f7061e02 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:45.593076 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-cb2771ef-56b4-4187-b90b-12c8217aaf0e req-ba5e4587-7fc3-40f8-9c4a-f899f7061e02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:45.593492 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-cb2771ef-56b4-4187-b90b-12c8217aaf0e req-ba5e4587-7fc3-40f8-9c4a-f899f7061e02 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:45.632675 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-cb2771ef-56b4-4187-b90b-12c8217aaf0e req-ba5e4587-7fc3-40f8-9c4a-f899f7061e02 admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:45.633156 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-cb2771ef-56b4-4187-b90b-12c8217aaf0e req-ba5e4587-7fc3-40f8-9c4a-f899f7061e02 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:45.633574 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-cb2771ef-56b4-4187-b90b-12c8217aaf0e req-ba5e4587-7fc3-40f8-9c4a-f899f7061e02 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:45.645374 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:45.658439 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-cb2771ef-56b4-4187-b90b-12c8217aaf0e req-ba5e4587-7fc3-40f8-9c4a-f899f7061e02 admin admin] 10.222.0.33 "DELETE /compute/v2.1/os-assisted-volume-snapshots/d0599feb-9d07-4c46-b076-cb2e4dfa8731?delete_info=%7B%22file_to_merge%22:%20%22volume-6f286035-7fde-4ab0-8864-edd54fdff1ff.d0599feb-9d07-4c46-b076-cb2e4dfa8731.vhdx%22,%20%22volume_id%22:%20%226f286035-7fde-4ab0-8864-edd54fdff1ff%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.129881 Oct 04 03:32:45.659022 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 199/400] 10.222.0.33 () {62 vars in 1800 bytes} [Tue Oct 4 03:32:45 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/d0599feb-9d07-4c46-b076-cb2e4dfa8731?delete_info=%7B%22file_to_merge%22:%20%22volume-6f286035-7fde-4ab0-8864-edd54fdff1ff.d0599feb-9d07-4c46-b076-cb2e4dfa8731.vhdx%22,%20%22volume_id%22:%20%226f286035-7fde-4ab0-8864-edd54fdff1ff%22%7D => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 03:32:46.327113 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a1db5e7e-497d-43e5-854d-edd992b1a795 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:46.327734 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a1db5e7e-497d-43e5-854d-edd992b1a795 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:46.333954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1db5e7e-497d-43e5-854d-edd992b1a795 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:46.334437 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1db5e7e-497d-43e5-854d-edd992b1a795 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:46.334873 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1db5e7e-497d-43e5-854d-edd992b1a795 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:46.335594 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1db5e7e-497d-43e5-854d-edd992b1a795 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:46.336047 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1db5e7e-497d-43e5-854d-edd992b1a795 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:46.336469 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1db5e7e-497d-43e5-854d-edd992b1a795 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:46.463421 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-a1db5e7e-497d-43e5-854d-edd992b1a795 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lazy-loading 'services' on Instance uuid 6d49bbae-bf97-4c67-a54a-3625acee0ba0 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:32:46.576968 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a1db5e7e-497d-43e5-854d-edd992b1a795 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/os-volume_attachments/d14d8b0d-3c6d-4edc-ad90-b164f6028b5b" status: 202 len: 0 microversion: 2.1 time: 0.255249 Oct 04 03:32:46.577626 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 202/401] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Oct 4 03:32:46 2022] DELETE /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/os-volume_attachments/d14d8b0d-3c6d-4edc-ad90-b164f6028b5b => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:32:48.708819 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-db1145ac-7746-4dd6-a47f-ede719ec83b8 req-cf25a87b-d7da-498c-9042-67218b8664b7 admin admin] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:48.712122 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-db1145ac-7746-4dd6-a47f-ede719ec83b8 req-cf25a87b-d7da-498c-9042-67218b8664b7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:48.713218 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-db1145ac-7746-4dd6-a47f-ede719ec83b8 req-cf25a87b-d7da-498c-9042-67218b8664b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:48.713742 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-db1145ac-7746-4dd6-a47f-ede719ec83b8 req-cf25a87b-d7da-498c-9042-67218b8664b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:48.722368 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-db1145ac-7746-4dd6-a47f-ede719ec83b8 req-cf25a87b-d7da-498c-9042-67218b8664b7 admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:48.722837 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-db1145ac-7746-4dd6-a47f-ede719ec83b8 req-cf25a87b-d7da-498c-9042-67218b8664b7 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:48.723264 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-db1145ac-7746-4dd6-a47f-ede719ec83b8 req-cf25a87b-d7da-498c-9042-67218b8664b7 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:48.737396 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-db1145ac-7746-4dd6-a47f-ede719ec83b8 req-cf25a87b-d7da-498c-9042-67218b8664b7 admin admin] 10.222.0.33 "DELETE /compute/v2.1/os-assisted-volume-snapshots/78e0c03b-d9a0-414e-adb5-b8d9a150f821?delete_info=%7B%22file_to_merge%22:%20%22volume-6f286035-7fde-4ab0-8864-edd54fdff1ff.78e0c03b-d9a0-414e-adb5-b8d9a150f821.vhdx%22,%20%22volume_id%22:%20%226f286035-7fde-4ab0-8864-edd54fdff1ff%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.077879 Oct 04 03:32:48.737974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 200/402] 10.222.0.33 () {62 vars in 1800 bytes} [Tue Oct 4 03:32:48 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/78e0c03b-d9a0-414e-adb5-b8d9a150f821?delete_info=%7B%22file_to_merge%22:%20%22volume-6f286035-7fde-4ab0-8864-edd54fdff1ff.78e0c03b-d9a0-414e-adb5-b8d9a150f821.vhdx%22,%20%22volume_id%22:%20%226f286035-7fde-4ab0-8864-edd54fdff1ff%22%7D => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:32:48.762975 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6ca549a0-3eb3-4a24-a810-68a4db869765 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:48.769213 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ca549a0-3eb3-4a24-a810-68a4db869765 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:48.769791 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ca549a0-3eb3-4a24-a810-68a4db869765 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:48.770410 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ca549a0-3eb3-4a24-a810-68a4db869765 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:48.797008 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6ca549a0-3eb3-4a24-a810-68a4db869765 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Going to try to stop instance {{(pid=120594) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 03:32:48.842229 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6ca549a0-3eb3-4a24-a810-68a4db869765 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "POST /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/action" status: 202 len: 0 microversion: 2.1 time: 0.084995 Oct 04 03:32:48.842828 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 203/403] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Oct 4 03:32:48 2022] POST /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:32:48.851512 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0f573377-5613-44b2-902c-4eca2171b8e4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:48.852214 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-0f573377-5613-44b2-902c-4eca2171b8e4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:48.858303 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0f573377-5613-44b2-902c-4eca2171b8e4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:48.858775 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0f573377-5613-44b2-902c-4eca2171b8e4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:48.859234 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0f573377-5613-44b2-902c-4eca2171b8e4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:48.859942 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0f573377-5613-44b2-902c-4eca2171b8e4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:48.860388 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0f573377-5613-44b2-902c-4eca2171b8e4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:48.860805 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0f573377-5613-44b2-902c-4eca2171b8e4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:48.991122 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0f573377-5613-44b2-902c-4eca2171b8e4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:48.998891 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0f573377-5613-44b2-902c-4eca2171b8e4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1676 microversion: 2.1 time: 0.151517 Oct 04 03:32:48.999447 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 201/404] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:48 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:50.023002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d40e1078-4cd1-4f9e-ba38-3f8b683349c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:50.023728 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d40e1078-4cd1-4f9e-ba38-3f8b683349c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:50.031443 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d40e1078-4cd1-4f9e-ba38-3f8b683349c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:50.031947 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d40e1078-4cd1-4f9e-ba38-3f8b683349c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:50.032404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d40e1078-4cd1-4f9e-ba38-3f8b683349c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:50.033151 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d40e1078-4cd1-4f9e-ba38-3f8b683349c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:50.033596 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d40e1078-4cd1-4f9e-ba38-3f8b683349c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:50.034027 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d40e1078-4cd1-4f9e-ba38-3f8b683349c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:50.172222 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-d40e1078-4cd1-4f9e-ba38-3f8b683349c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:50.179840 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d40e1078-4cd1-4f9e-ba38-3f8b683349c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1676 microversion: 2.1 time: 0.161180 Oct 04 03:32:50.180404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 204/405] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:50 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:51.203872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-15769e68-314e-4a0a-874f-58de2bab5679 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:51.204388 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-15769e68-314e-4a0a-874f-58de2bab5679 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:51.210785 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-15769e68-314e-4a0a-874f-58de2bab5679 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:51.211269 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-15769e68-314e-4a0a-874f-58de2bab5679 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:51.211753 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-15769e68-314e-4a0a-874f-58de2bab5679 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:51.212444 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-15769e68-314e-4a0a-874f-58de2bab5679 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:51.212985 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-15769e68-314e-4a0a-874f-58de2bab5679 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:51.213415 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-15769e68-314e-4a0a-874f-58de2bab5679 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:51.340288 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-15769e68-314e-4a0a-874f-58de2bab5679 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:51.347958 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-15769e68-314e-4a0a-874f-58de2bab5679 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1676 microversion: 2.1 time: 0.148010 Oct 04 03:32:51.348520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 202/406] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:51 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:51.786688 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-167e2208-94be-47f1-9d48-fdc0909d9126 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:51.787187 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-167e2208-94be-47f1-9d48-fdc0909d9126 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:51.794122 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-167e2208-94be-47f1-9d48-fdc0909d9126 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:51.794608 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-167e2208-94be-47f1-9d48-fdc0909d9126 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:51.795041 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-167e2208-94be-47f1-9d48-fdc0909d9126 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:51.795859 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-167e2208-94be-47f1-9d48-fdc0909d9126 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:51.796234 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-167e2208-94be-47f1-9d48-fdc0909d9126 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:51.796656 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-167e2208-94be-47f1-9d48-fdc0909d9126 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:51.821980 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-167e2208-94be-47f1-9d48-fdc0909d9126 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d/ips" status: 200 len: 150 microversion: 2.1 time: 0.038897 Oct 04 03:32:51.822754 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 205/407] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Oct 4 03:32:51 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:32:51.834775 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-06183979-ea39-444a-90df-84602e2490e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e5e16c0-a230-4fcb-a42f-480299c760af"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:51.838744 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-06183979-ea39-444a-90df-84602e2490e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:51.845688 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06183979-ea39-444a-90df-84602e2490e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:51.846366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06183979-ea39-444a-90df-84602e2490e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:51.847232 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06183979-ea39-444a-90df-84602e2490e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:51.849191 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06183979-ea39-444a-90df-84602e2490e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:51.850031 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06183979-ea39-444a-90df-84602e2490e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:51.850547 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06183979-ea39-444a-90df-84602e2490e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:51.859810 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-649a93b6-ac02-49d5-976c-6ab275cc77c2 req-96f123a2-7de8-45cf-90de-03ccedbca778 admin admin] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:51.863152 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-649a93b6-ac02-49d5-976c-6ab275cc77c2 req-96f123a2-7de8-45cf-90de-03ccedbca778 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:51.863746 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-649a93b6-ac02-49d5-976c-6ab275cc77c2 req-96f123a2-7de8-45cf-90de-03ccedbca778 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:51.864237 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-649a93b6-ac02-49d5-976c-6ab275cc77c2 req-96f123a2-7de8-45cf-90de-03ccedbca778 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:51.873503 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-649a93b6-ac02-49d5-976c-6ab275cc77c2 req-96f123a2-7de8-45cf-90de-03ccedbca778 admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:51.873903 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-649a93b6-ac02-49d5-976c-6ab275cc77c2 req-96f123a2-7de8-45cf-90de-03ccedbca778 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:51.874324 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-649a93b6-ac02-49d5-976c-6ab275cc77c2 req-96f123a2-7de8-45cf-90de-03ccedbca778 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:51.887260 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-649a93b6-ac02-49d5-976c-6ab275cc77c2 req-96f123a2-7de8-45cf-90de-03ccedbca778 admin admin] 10.222.0.33 "DELETE /compute/v2.1/os-assisted-volume-snapshots/436e8f16-cb14-4bb8-84ee-12170844400f?delete_info=%7B%22file_to_merge%22:%20%22volume-6f286035-7fde-4ab0-8864-edd54fdff1ff.436e8f16-cb14-4bb8-84ee-12170844400f.vhdx%22,%20%22volume_id%22:%20%226f286035-7fde-4ab0-8864-edd54fdff1ff%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.084340 Oct 04 03:32:51.887859 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 203/408] 10.222.0.33 () {62 vars in 1800 bytes} [Tue Oct 4 03:32:51 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/436e8f16-cb14-4bb8-84ee-12170844400f?delete_info=%7B%22file_to_merge%22:%20%22volume-6f286035-7fde-4ab0-8864-edd54fdff1ff.436e8f16-cb14-4bb8-84ee-12170844400f.vhdx%22,%20%22volume_id%22:%20%226f286035-7fde-4ab0-8864-edd54fdff1ff%22%7D => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 03:32:51.941130 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-06183979-ea39-444a-90df-84602e2490e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] HTTP exception thrown: Invalid volume: volume 7e5e16c0-a230-4fcb-a42f-480299c760af is already attached to instances: 79803288-b24a-4fcd-9ed9-b08111250cc5 Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-06183979-ea39-444a-90df-84602e2490e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Request method failure captured: Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: POST /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d/os-volume_attachments HTTP/1.1 Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 74 Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6isUYhgYsAb2pqxJ5i2_6gzGtKyJzLe2quMbLKiFrXtrxQIhaAv2XwsUqEAkN7Fh1WqlIXaqgH_JRfN3W7XWKG2TyqZRi_OBW_0jILA2kaoQ2SSAvWUeuuoQxbaW7Q90VlSmfhWYx2fgtTX4JS2Hb0X2tvDyvvlYbTndLm_mtGSa4s Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:32:51.942908 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:32:51.944672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d6ee89cb464afa95e222b2a1e7279b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d6ee89cb464afa95e222b2a1e7279b"}]}] Oct 04 03:32:51.944672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:32:51.944672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:32:51.944672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:32:51.944672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:32:51.944672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:32:51.944672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:32:51.944672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: b8795829c34046628cae345dd4d45e75 Oct 04 03:32:51.944672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:32:51.944672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Oct 04 03:32:51.944672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {"volumeAttachment": {"volumeId": "7e5e16c0-a230-4fcb-a42f-480299c760af"}} Oct 04 03:32:51.944672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Invalid volume: volume 7e5e16c0-a230-4fcb-a42f-480299c760af is already attached to instances: 79803288-b24a-4fcd-9ed9-b08111250cc5 Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'server_id': '86a755ac-b03d-459e-ae14-f1242058a16d', 'body': {'volumeAttachment': {'volumeId': '7e5e16c0-a230-4fcb-a42f-480299c760af'}}} Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7e5e16c0-a230-4fcb-a42f-480299c760af is already attached to instances: 79803288-b24a-4fcd-9ed9-b08111250cc5 Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:32:51.945450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7e5e16c0-a230-4fcb-a42f-480299c760af is already attached to instances: 79803288-b24a-4fcd-9ed9-b08111250cc5 Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:32:51.947030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:32:51.948259 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:32:51.948259 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:32:51.948259 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:32:51.948259 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7e5e16c0-a230-4fcb-a42f-480299c760af is already attached to instances: 79803288-b24a-4fcd-9ed9-b08111250cc5 Oct 04 03:32:51.948259 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:32:51.948259 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-06183979-ea39-444a-90df-84602e2490e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Returning 400 to user: Invalid volume: volume 7e5e16c0-a230-4fcb-a42f-480299c760af is already attached to instances: 79803288-b24a-4fcd-9ed9-b08111250cc5 {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:32:51.948259 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-06183979-ea39-444a-90df-84602e2490e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "POST /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114172 Oct 04 03:32:51.948259 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 206/409] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Oct 4 03:32:51 2022] POST /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 03:32:51.954855 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-aadeeebe-4f1a-44e4-9d10-fe617ce9706e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:51.955434 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-aadeeebe-4f1a-44e4-9d10-fe617ce9706e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:51.961567 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-aadeeebe-4f1a-44e4-9d10-fe617ce9706e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:51.962558 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-aadeeebe-4f1a-44e4-9d10-fe617ce9706e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:51.963542 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-aadeeebe-4f1a-44e4-9d10-fe617ce9706e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:51.964231 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-aadeeebe-4f1a-44e4-9d10-fe617ce9706e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:51.964684 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-aadeeebe-4f1a-44e4-9d10-fe617ce9706e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:51.965106 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-aadeeebe-4f1a-44e4-9d10-fe617ce9706e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:51.990782 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-aadeeebe-4f1a-44e4-9d10-fe617ce9706e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Going to try to terminate instance {{(pid=120595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:32:52.075390 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-aadeeebe-4f1a-44e4-9d10-fe617ce9706e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 204 len: 0 microversion: 2.1 time: 0.124422 Oct 04 03:32:52.075991 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 204/410] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:32:51 2022] DELETE /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:32:52.084095 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bb859a64-4bc7-4ecf-8def-693cec510d21 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:52.084702 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bb859a64-4bc7-4ecf-8def-693cec510d21 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:52.092314 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb859a64-4bc7-4ecf-8def-693cec510d21 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:52.092794 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb859a64-4bc7-4ecf-8def-693cec510d21 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:52.093228 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb859a64-4bc7-4ecf-8def-693cec510d21 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:52.093911 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb859a64-4bc7-4ecf-8def-693cec510d21 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:52.094370 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb859a64-4bc7-4ecf-8def-693cec510d21 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:52.094791 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb859a64-4bc7-4ecf-8def-693cec510d21 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:52.225647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-bb859a64-4bc7-4ecf-8def-693cec510d21 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:52.234313 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bb859a64-4bc7-4ecf-8def-693cec510d21 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1682 microversion: 2.1 time: 0.153949 Oct 04 03:32:52.234869 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 207/411] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:52 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:52.374499 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-69ee50ff-cca8-432c-bfc0-a50d0db104a0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:52.375187 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-69ee50ff-cca8-432c-bfc0-a50d0db104a0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:52.381530 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-69ee50ff-cca8-432c-bfc0-a50d0db104a0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:52.382006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-69ee50ff-cca8-432c-bfc0-a50d0db104a0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:52.382453 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-69ee50ff-cca8-432c-bfc0-a50d0db104a0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:52.383137 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-69ee50ff-cca8-432c-bfc0-a50d0db104a0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:52.383613 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-69ee50ff-cca8-432c-bfc0-a50d0db104a0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:52.384038 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-69ee50ff-cca8-432c-bfc0-a50d0db104a0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:52.521146 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-69ee50ff-cca8-432c-bfc0-a50d0db104a0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:52.529231 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-69ee50ff-cca8-432c-bfc0-a50d0db104a0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1676 microversion: 2.1 time: 0.158944 Oct 04 03:32:52.529789 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 205/412] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:52 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:53.259352 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1e22541f-3404-4232-a52c-94a931a4a9c6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:53.259981 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1e22541f-3404-4232-a52c-94a931a4a9c6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:53.261961 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:53.267957 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e22541f-3404-4232-a52c-94a931a4a9c6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:53.268433 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e22541f-3404-4232-a52c-94a931a4a9c6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:53.268859 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e22541f-3404-4232-a52c-94a931a4a9c6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:53.269535 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e22541f-3404-4232-a52c-94a931a4a9c6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:53.269977 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e22541f-3404-4232-a52c-94a931a4a9c6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:53.270392 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e22541f-3404-4232-a52c-94a931a4a9c6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:53.398997 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1e22541f-3404-4232-a52c-94a931a4a9c6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:53.407160 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1e22541f-3404-4232-a52c-94a931a4a9c6 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1682 microversion: 2.1 time: 0.151986 Oct 04 03:32:53.407742 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 208/413] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:53 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:53.553588 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6d591921-012b-4f00-9537-98219faff9c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:53.554110 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6d591921-012b-4f00-9537-98219faff9c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:53.561431 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d591921-012b-4f00-9537-98219faff9c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:53.561910 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d591921-012b-4f00-9537-98219faff9c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:53.562337 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d591921-012b-4f00-9537-98219faff9c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:53.563015 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d591921-012b-4f00-9537-98219faff9c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:53.563464 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d591921-012b-4f00-9537-98219faff9c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:53.563906 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d591921-012b-4f00-9537-98219faff9c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:53.694896 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6d591921-012b-4f00-9537-98219faff9c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:53.702681 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6d591921-012b-4f00-9537-98219faff9c6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1676 microversion: 2.1 time: 0.152998 Oct 04 03:32:53.703239 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 206/414] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:53 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:54.430161 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-380856b4-11fa-4bbf-9fcd-5cd66c3737a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:54.431221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-380856b4-11fa-4bbf-9fcd-5cd66c3737a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:54.437912 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-380856b4-11fa-4bbf-9fcd-5cd66c3737a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:54.438401 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-380856b4-11fa-4bbf-9fcd-5cd66c3737a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:54.438833 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-380856b4-11fa-4bbf-9fcd-5cd66c3737a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:54.439592 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-380856b4-11fa-4bbf-9fcd-5cd66c3737a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:54.440047 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-380856b4-11fa-4bbf-9fcd-5cd66c3737a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:54.441563 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-380856b4-11fa-4bbf-9fcd-5cd66c3737a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:54.570350 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-380856b4-11fa-4bbf-9fcd-5cd66c3737a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:54.578461 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-380856b4-11fa-4bbf-9fcd-5cd66c3737a4 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1682 microversion: 2.1 time: 0.152148 Oct 04 03:32:54.579022 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 209/415] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:54 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:54.726035 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a2ae475d-3f0b-44b0-ad25-f3d9ca2eb054 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:54.726662 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a2ae475d-3f0b-44b0-ad25-f3d9ca2eb054 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:54.733218 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a2ae475d-3f0b-44b0-ad25-f3d9ca2eb054 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:54.733692 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a2ae475d-3f0b-44b0-ad25-f3d9ca2eb054 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:54.734117 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a2ae475d-3f0b-44b0-ad25-f3d9ca2eb054 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:54.734795 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a2ae475d-3f0b-44b0-ad25-f3d9ca2eb054 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:54.735236 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a2ae475d-3f0b-44b0-ad25-f3d9ca2eb054 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:54.735685 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a2ae475d-3f0b-44b0-ad25-f3d9ca2eb054 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:54.865195 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a2ae475d-3f0b-44b0-ad25-f3d9ca2eb054 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:54.872773 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a2ae475d-3f0b-44b0-ad25-f3d9ca2eb054 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1676 microversion: 2.1 time: 0.150541 Oct 04 03:32:54.873329 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 207/416] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:54 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:55.602237 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f08f1ede-5dd4-4e60-bdb8-837413cbfc29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:55.603348 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f08f1ede-5dd4-4e60-bdb8-837413cbfc29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:55.609640 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f08f1ede-5dd4-4e60-bdb8-837413cbfc29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:55.610127 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f08f1ede-5dd4-4e60-bdb8-837413cbfc29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:55.610561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f08f1ede-5dd4-4e60-bdb8-837413cbfc29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:55.611255 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f08f1ede-5dd4-4e60-bdb8-837413cbfc29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:55.611741 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f08f1ede-5dd4-4e60-bdb8-837413cbfc29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:55.612163 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f08f1ede-5dd4-4e60-bdb8-837413cbfc29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:55.836427 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f08f1ede-5dd4-4e60-bdb8-837413cbfc29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:55.845045 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f08f1ede-5dd4-4e60-bdb8-837413cbfc29 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1682 microversion: 2.1 time: 0.246718 Oct 04 03:32:55.845607 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 210/417] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:55 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1682 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:55.898775 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a084501f-3745-430c-8328-6dae407d96fa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:55.899988 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a084501f-3745-430c-8328-6dae407d96fa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:55.906143 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a084501f-3745-430c-8328-6dae407d96fa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:55.906639 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a084501f-3745-430c-8328-6dae407d96fa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:55.907062 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a084501f-3745-430c-8328-6dae407d96fa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:55.907784 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a084501f-3745-430c-8328-6dae407d96fa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:55.908236 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a084501f-3745-430c-8328-6dae407d96fa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:55.908659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a084501f-3745-430c-8328-6dae407d96fa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:56.152072 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a084501f-3745-430c-8328-6dae407d96fa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:56.160876 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a084501f-3745-430c-8328-6dae407d96fa tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1676 microversion: 2.1 time: 0.267650 Oct 04 03:32:56.161543 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 208/418] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:55 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1676 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:56.323161 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-159b1764-4573-4811-946f-6ce757dd0a3c req-ff022d8b-6fb3-4d5b-a94d-873bb1cdaa7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a755ac-b03d-459e-ae14-f1242058a16d", "name": "network-vif-deleted", "tag": "de114046-4ed3-41d6-9359-fb41b5df6907"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:32:56.335061 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-159b1764-4573-4811-946f-6ce757dd0a3c req-ff022d8b-6fb3-4d5b-a94d-873bb1cdaa7a service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:56.336156 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-159b1764-4573-4811-946f-6ce757dd0a3c req-ff022d8b-6fb3-4d5b-a94d-873bb1cdaa7a service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:56.336595 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-159b1764-4573-4811-946f-6ce757dd0a3c req-ff022d8b-6fb3-4d5b-a94d-873bb1cdaa7a service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:56.348928 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-159b1764-4573-4811-946f-6ce757dd0a3c req-ff022d8b-6fb3-4d5b-a94d-873bb1cdaa7a service nova] Creating event network-vif-deleted:de114046-4ed3-41d6-9359-fb41b5df6907 for instance 86a755ac-b03d-459e-ae14-f1242058a16d on hv-cinder-84914 Oct 04 03:32:56.355867 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-159b1764-4573-4811-946f-6ce757dd0a3c req-ff022d8b-6fb3-4d5b-a94d-873bb1cdaa7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036362 Oct 04 03:32:56.356802 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 211/419] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:32:56.869157 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-969a086d-71b1-4f92-8ca7-a82bfdcf8c38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:56.870074 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-969a086d-71b1-4f92-8ca7-a82bfdcf8c38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:56.876244 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-969a086d-71b1-4f92-8ca7-a82bfdcf8c38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:56.876732 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-969a086d-71b1-4f92-8ca7-a82bfdcf8c38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:56.877177 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-969a086d-71b1-4f92-8ca7-a82bfdcf8c38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:56.877869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-969a086d-71b1-4f92-8ca7-a82bfdcf8c38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:56.878320 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-969a086d-71b1-4f92-8ca7-a82bfdcf8c38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:56.878742 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-969a086d-71b1-4f92-8ca7-a82bfdcf8c38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:56.913641 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-969a086d-71b1-4f92-8ca7-a82bfdcf8c38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:56.914275 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-969a086d-71b1-4f92-8ca7-a82bfdcf8c38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:56.914717 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-969a086d-71b1-4f92-8ca7-a82bfdcf8c38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:56.915348 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-969a086d-71b1-4f92-8ca7-a82bfdcf8c38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lazy-loading 'fault' on Instance uuid 86a755ac-b03d-459e-ae14-f1242058a16d {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:32:56.926285 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ecff3e88-31ea-4e5e-bce7-1e2005ef860b tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:56.926859 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ecff3e88-31ea-4e5e-bce7-1e2005ef860b tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:56.947601 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ecff3e88-31ea-4e5e-bce7-1e2005ef860b tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:56.948427 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ecff3e88-31ea-4e5e-bce7-1e2005ef860b tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:56.949060 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ecff3e88-31ea-4e5e-bce7-1e2005ef860b tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:56.949948 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ecff3e88-31ea-4e5e-bce7-1e2005ef860b tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:56.950836 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ecff3e88-31ea-4e5e-bce7-1e2005ef860b tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:56.951572 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ecff3e88-31ea-4e5e-bce7-1e2005ef860b tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:56.962834 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-969a086d-71b1-4f92-8ca7-a82bfdcf8c38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:56.973704 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-969a086d-71b1-4f92-8ca7-a82bfdcf8c38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 200 len: 1331 microversion: 2.1 time: 0.108168 Oct 04 03:32:56.975517 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 209/420] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:56 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:57.075133 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-ecff3e88-31ea-4e5e-bce7-1e2005ef860b tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lazy-loading 'services' on Instance uuid 9fe86068-8683-468f-a300-d8b7bac8d2c1 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:32:57.161126 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ecff3e88-31ea-4e5e-bce7-1e2005ef860b tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1/os-volume_attachments/6f286035-7fde-4ab0-8864-edd54fdff1ff" status: 202 len: 0 microversion: 2.1 time: 0.238974 Oct 04 03:32:57.162273 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 212/421] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Oct 4 03:32:56 2022] DELETE /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1/os-volume_attachments/6f286035-7fde-4ab0-8864-edd54fdff1ff => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 03:32:57.187224 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9c7cb260-e51e-4be4-a711-093cb89d78d8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:57.188490 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-9c7cb260-e51e-4be4-a711-093cb89d78d8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:57.198476 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c7cb260-e51e-4be4-a711-093cb89d78d8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:57.200101 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c7cb260-e51e-4be4-a711-093cb89d78d8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:57.201186 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c7cb260-e51e-4be4-a711-093cb89d78d8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:57.202264 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c7cb260-e51e-4be4-a711-093cb89d78d8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:57.203044 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c7cb260-e51e-4be4-a711-093cb89d78d8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:57.204965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c7cb260-e51e-4be4-a711-093cb89d78d8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:57.379846 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-9c7cb260-e51e-4be4-a711-093cb89d78d8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:57.388463 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-9c7cb260-e51e-4be4-a711-093cb89d78d8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1676 microversion: 2.1 time: 0.205569 Oct 04 03:32:57.389339 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 210/422] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:57 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:58.000021 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-419f2ba8-5d91-4acd-88da-5dfcefcc1d07 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:58.000681 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-419f2ba8-5d91-4acd-88da-5dfcefcc1d07 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:58.007052 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-419f2ba8-5d91-4acd-88da-5dfcefcc1d07 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:58.007577 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-419f2ba8-5d91-4acd-88da-5dfcefcc1d07 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:58.008014 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-419f2ba8-5d91-4acd-88da-5dfcefcc1d07 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:58.008721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-419f2ba8-5d91-4acd-88da-5dfcefcc1d07 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:58.009754 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-419f2ba8-5d91-4acd-88da-5dfcefcc1d07 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:58.010179 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-419f2ba8-5d91-4acd-88da-5dfcefcc1d07 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:58.023417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-419f2ba8-5d91-4acd-88da-5dfcefcc1d07 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] HTTP exception thrown: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-419f2ba8-5d91-4acd-88da-5dfcefcc1d07 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Request method failure captured: Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d HTTP/1.1 Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6isUYhgYsAb2pqxJ5i2_6gzGtKyJzLe2quMbLKiFrXtrxQIhaAv2XwsUqEAkN7Fh1WqlIXaqgH_JRfN3W7XWKG2TyqZRi_OBW_0jILA2kaoQ2SSAvWUeuuoQxbaW7Q90VlSmfhWYx2fgtTX4JS2Hb0X2tvDyvvlYbTndLm_mtGSa4s Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:32:58.025147 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:32:58.026692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d6ee89cb464afa95e222b2a1e7279b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d6ee89cb464afa95e222b2a1e7279b"}]}] Oct 04 03:32:58.026692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:32:58.026692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:32:58.026692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:32:58.026692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:32:58.026692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:32:58.026692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:32:58.026692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: b8795829c34046628cae345dd4d45e75 Oct 04 03:32:58.026692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:32:58.026692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:32:58.026692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:32:58.026692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '86a755ac-b03d-459e-ae14-f1242058a16d'} Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:32:58.027441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:32:58.028808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:32:58.030100 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-419f2ba8-5d91-4acd-88da-5dfcefcc1d07 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Returning 404 to user: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:32:58.030100 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-419f2ba8-5d91-4acd-88da-5dfcefcc1d07 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 404 len: 111 microversion: 2.1 time: 0.031737 Oct 04 03:32:58.030100 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 213/423] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:57 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:32:58.035306 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-795cb8ad-06c9-4f7a-951f-fad958385865 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '.version_select at 0x7f165b50fee0>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:58.054657 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-795cb8ad-06c9-4f7a-951f-fad958385865 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341174055" status: 202 len: 0 microversion: 2.1 time: 0.023057 Oct 04 03:32:58.055212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 211/424] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Oct 4 03:32:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341174055 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:32:58.297981 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4e6a82ef-9380-4323-af46-3f2e9d72d6ba tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:58.298483 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4e6a82ef-9380-4323-af46-3f2e9d72d6ba tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:58.304405 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4e6a82ef-9380-4323-af46-3f2e9d72d6ba tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:58.304892 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4e6a82ef-9380-4323-af46-3f2e9d72d6ba tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:58.305687 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4e6a82ef-9380-4323-af46-3f2e9d72d6ba tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:58.306905 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4e6a82ef-9380-4323-af46-3f2e9d72d6ba tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:58.307545 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4e6a82ef-9380-4323-af46-3f2e9d72d6ba tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:58.307975 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4e6a82ef-9380-4323-af46-3f2e9d72d6ba tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:58.336737 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4e6a82ef-9380-4323-af46-3f2e9d72d6ba tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:32:58.389686 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:58.412967 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-edddeab1-4d37-4f7a-bfaf-f865e16c71fc tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:58.413473 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-edddeab1-4d37-4f7a-bfaf-f865e16c71fc tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:58.423380 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-edddeab1-4d37-4f7a-bfaf-f865e16c71fc tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:58.423919 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-edddeab1-4d37-4f7a-bfaf-f865e16c71fc tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:58.424915 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-edddeab1-4d37-4f7a-bfaf-f865e16c71fc tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:58.425043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-edddeab1-4d37-4f7a-bfaf-f865e16c71fc tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:58.425486 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-edddeab1-4d37-4f7a-bfaf-f865e16c71fc tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:58.425904 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-edddeab1-4d37-4f7a-bfaf-f865e16c71fc tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:58.429988 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4e6a82ef-9380-4323-af46-3f2e9d72d6ba tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 204 len: 0 microversion: 2.1 time: 0.135344 Oct 04 03:32:58.431329 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 214/425] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:32:58 2022] DELETE /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:32:58.451391 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6c312317-7d27-4558-95a4-9b7502d21334 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:58.452583 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6c312317-7d27-4558-95a4-9b7502d21334 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:58.460530 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6c312317-7d27-4558-95a4-9b7502d21334 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:58.461865 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6c312317-7d27-4558-95a4-9b7502d21334 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:58.463306 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6c312317-7d27-4558-95a4-9b7502d21334 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:58.464401 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6c312317-7d27-4558-95a4-9b7502d21334 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:58.465106 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6c312317-7d27-4558-95a4-9b7502d21334 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:58.465922 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6c312317-7d27-4558-95a4-9b7502d21334 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:58.650278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-edddeab1-4d37-4f7a-bfaf-f865e16c71fc tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:58.653313 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6c312317-7d27-4558-95a4-9b7502d21334 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:58.663204 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6c312317-7d27-4558-95a4-9b7502d21334 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1513 microversion: 2.1 time: 0.227301 Oct 04 03:32:58.664218 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 215/426] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:58 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:58.664423 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-edddeab1-4d37-4f7a-bfaf-f865e16c71fc tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1676 microversion: 2.1 time: 0.255851 Oct 04 03:32:58.665102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 212/427] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:58 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1676 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:58.790040 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a6af7ddf-db57-45e4-8646-96e472016486 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:58.790665 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a6af7ddf-db57-45e4-8646-96e472016486 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:58.796591 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6af7ddf-db57-45e4-8646-96e472016486 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:58.797064 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6af7ddf-db57-45e4-8646-96e472016486 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:58.797488 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6af7ddf-db57-45e4-8646-96e472016486 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:58.798166 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6af7ddf-db57-45e4-8646-96e472016486 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:58.798605 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6af7ddf-db57-45e4-8646-96e472016486 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:58.799019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6af7ddf-db57-45e4-8646-96e472016486 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:58.882035 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-a6af7ddf-db57-45e4-8646-96e472016486 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lazy-loading 'services' on Instance uuid 79803288-b24a-4fcd-9ed9-b08111250cc5 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:32:58.950972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a6af7ddf-db57-45e4-8646-96e472016486 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments/7e5e16c0-a230-4fcb-a42f-480299c760af" status: 202 len: 0 microversion: 2.1 time: 0.164676 Oct 04 03:32:58.951603 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 216/428] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Oct 4 03:32:58 2022] DELETE /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments/7e5e16c0-a230-4fcb-a42f-480299c760af => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:32:58.959775 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-ab5ac10f-424e-4b69-813d-fd0bac1acb38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:58.962751 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-ab5ac10f-424e-4b69-813d-fd0bac1acb38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:58.968718 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ab5ac10f-424e-4b69-813d-fd0bac1acb38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:58.969205 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ab5ac10f-424e-4b69-813d-fd0bac1acb38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:58.969648 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ab5ac10f-424e-4b69-813d-fd0bac1acb38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:58.970361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ab5ac10f-424e-4b69-813d-fd0bac1acb38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:58.970812 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ab5ac10f-424e-4b69-813d-fd0bac1acb38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:58.971234 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ab5ac10f-424e-4b69-813d-fd0bac1acb38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:59.000805 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-ab5ac10f-424e-4b69-813d-fd0bac1acb38 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044920 Oct 04 03:32:59.001361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 213/429] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:32:58 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:32:59.684387 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 03:32:59.684929 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Tue Oct 4 03:32:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 (ip 10.222.0.25) !!! Oct 04 03:32:59.689175 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-17a0f168-59e0-4679-9ab9-2b75f404c507 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:59.690090 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-17a0f168-59e0-4679-9ab9-2b75f404c507 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:59.690262 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4b5af4ca-6790-48d7-a682-fbe5fe957e86 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:32:59.690952 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4b5af4ca-6790-48d7-a682-fbe5fe957e86 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:32:59.699908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-17a0f168-59e0-4679-9ab9-2b75f404c507 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:59.700165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4b5af4ca-6790-48d7-a682-fbe5fe957e86 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:59.700383 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4b5af4ca-6790-48d7-a682-fbe5fe957e86 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:59.700694 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-17a0f168-59e0-4679-9ab9-2b75f404c507 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:59.700860 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4b5af4ca-6790-48d7-a682-fbe5fe957e86 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:59.701220 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-17a0f168-59e0-4679-9ab9-2b75f404c507 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:59.701470 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4b5af4ca-6790-48d7-a682-fbe5fe957e86 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:59.701911 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4b5af4ca-6790-48d7-a682-fbe5fe957e86 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:59.702030 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-17a0f168-59e0-4679-9ab9-2b75f404c507 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:32:59.702327 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4b5af4ca-6790-48d7-a682-fbe5fe957e86 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:59.702528 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-17a0f168-59e0-4679-9ab9-2b75f404c507 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:32:59.702989 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-17a0f168-59e0-4679-9ab9-2b75f404c507 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:32:59.893368 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-4b5af4ca-6790-48d7-a682-fbe5fe957e86 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:59.901153 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-17a0f168-59e0-4679-9ab9-2b75f404c507 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:32:59.902353 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4b5af4ca-6790-48d7-a682-fbe5fe957e86 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1513 microversion: 2.1 time: 0.219242 Oct 04 03:32:59.906399 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 217/430] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:59 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:32:59.909335 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-17a0f168-59e0-4679-9ab9-2b75f404c507 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1676 microversion: 2.1 time: 0.225145 Oct 04 03:32:59.910042 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 214/431] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:32:59 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:00.013165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8bd2232a-6a51-4eca-a807-5729d173249b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:00.015352 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8bd2232a-6a51-4eca-a807-5729d173249b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:00.021379 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8bd2232a-6a51-4eca-a807-5729d173249b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:00.021850 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8bd2232a-6a51-4eca-a807-5729d173249b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:00.022274 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8bd2232a-6a51-4eca-a807-5729d173249b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:00.022950 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8bd2232a-6a51-4eca-a807-5729d173249b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:00.023392 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8bd2232a-6a51-4eca-a807-5729d173249b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:00.023838 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8bd2232a-6a51-4eca-a807-5729d173249b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:00.052840 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8bd2232a-6a51-4eca-a807-5729d173249b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044041 Oct 04 03:33:00.053376 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 218/432] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:33:00 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:00.925997 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-ecc0639d-c1b6-4c2f-84f4-a6bf76e44b64 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:00.927625 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-ecc0639d-c1b6-4c2f-84f4-a6bf76e44b64 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:00.932732 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-dd150279-228f-4afd-a96d-5ae995fa930c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:00.933360 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-dd150279-228f-4afd-a96d-5ae995fa930c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:00.934709 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ecc0639d-c1b6-4c2f-84f4-a6bf76e44b64 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:00.935202 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ecc0639d-c1b6-4c2f-84f4-a6bf76e44b64 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:00.935668 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ecc0639d-c1b6-4c2f-84f4-a6bf76e44b64 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:00.936355 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ecc0639d-c1b6-4c2f-84f4-a6bf76e44b64 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:00.936818 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ecc0639d-c1b6-4c2f-84f4-a6bf76e44b64 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:00.937265 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ecc0639d-c1b6-4c2f-84f4-a6bf76e44b64 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:00.937601 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:00.942482 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dd150279-228f-4afd-a96d-5ae995fa930c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:00.943058 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dd150279-228f-4afd-a96d-5ae995fa930c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:00.943928 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dd150279-228f-4afd-a96d-5ae995fa930c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:00.944725 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dd150279-228f-4afd-a96d-5ae995fa930c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:00.945274 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dd150279-228f-4afd-a96d-5ae995fa930c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:00.945787 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dd150279-228f-4afd-a96d-5ae995fa930c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:01.135313 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-ecc0639d-c1b6-4c2f-84f4-a6bf76e44b64 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:01.138095 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-dd150279-228f-4afd-a96d-5ae995fa930c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:01.143020 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-ecc0639d-c1b6-4c2f-84f4-a6bf76e44b64 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1513 microversion: 2.1 time: 0.220950 Oct 04 03:33:01.143604 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 215/433] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:00 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:01.146827 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-dd150279-228f-4afd-a96d-5ae995fa930c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1676 microversion: 2.1 time: 0.218308 Oct 04 03:33:01.147538 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 219/434] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:00 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:01.148453 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-73e49fd9-20ac-4e46-94ce-e63ca33b50a5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:01.151376 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-73e49fd9-20ac-4e46-94ce-e63ca33b50a5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:01.157479 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-73e49fd9-20ac-4e46-94ce-e63ca33b50a5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:01.157959 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-73e49fd9-20ac-4e46-94ce-e63ca33b50a5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:01.158395 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-73e49fd9-20ac-4e46-94ce-e63ca33b50a5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:01.159077 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-73e49fd9-20ac-4e46-94ce-e63ca33b50a5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:01.159544 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-73e49fd9-20ac-4e46-94ce-e63ca33b50a5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:01.159971 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-73e49fd9-20ac-4e46-94ce-e63ca33b50a5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:01.185327 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:01.190765 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-73e49fd9-20ac-4e46-94ce-e63ca33b50a5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046204 Oct 04 03:33:01.191332 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 216/435] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:33:01 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:02.167141 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b8332755-2fd7-4edd-b23e-129b6b9003e7 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:02.168394 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b8332755-2fd7-4edd-b23e-129b6b9003e7 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:02.170969 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-100effd3-c7e5-412a-be79-5c111e40e14a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:02.171587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-100effd3-c7e5-412a-be79-5c111e40e14a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:02.173367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=6 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:02.175774 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8332755-2fd7-4edd-b23e-129b6b9003e7 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:02.175923 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8332755-2fd7-4edd-b23e-129b6b9003e7 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:02.176662 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8332755-2fd7-4edd-b23e-129b6b9003e7 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:02.177863 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8332755-2fd7-4edd-b23e-129b6b9003e7 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:02.178327 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8332755-2fd7-4edd-b23e-129b6b9003e7 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:02.178807 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8332755-2fd7-4edd-b23e-129b6b9003e7 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:02.180372 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-100effd3-c7e5-412a-be79-5c111e40e14a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:02.180662 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-100effd3-c7e5-412a-be79-5c111e40e14a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:02.181622 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-100effd3-c7e5-412a-be79-5c111e40e14a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:02.182372 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-100effd3-c7e5-412a-be79-5c111e40e14a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:02.182821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-100effd3-c7e5-412a-be79-5c111e40e14a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:02.183241 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-100effd3-c7e5-412a-be79-5c111e40e14a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:02.374623 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b8332755-2fd7-4edd-b23e-129b6b9003e7 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:02.381559 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-100effd3-c7e5-412a-be79-5c111e40e14a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:02.387964 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b8332755-2fd7-4edd-b23e-129b6b9003e7 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1513 microversion: 2.1 time: 0.225394 Oct 04 03:33:02.388769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 220/436] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:02 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:02.389675 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-100effd3-c7e5-412a-be79-5c111e40e14a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1676 microversion: 2.1 time: 0.222901 Oct 04 03:33:02.390345 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 217/437] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:02 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1676 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:02.393353 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3f850d34-9894-492d-b47c-e0ae9d927413 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:02.395530 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3f850d34-9894-492d-b47c-e0ae9d927413 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:02.401691 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f850d34-9894-492d-b47c-e0ae9d927413 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:02.402168 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f850d34-9894-492d-b47c-e0ae9d927413 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:02.402593 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f850d34-9894-492d-b47c-e0ae9d927413 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:02.403270 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f850d34-9894-492d-b47c-e0ae9d927413 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:02.403743 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f850d34-9894-492d-b47c-e0ae9d927413 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:02.404158 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f850d34-9894-492d-b47c-e0ae9d927413 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:02.433048 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3f850d34-9894-492d-b47c-e0ae9d927413 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043237 Oct 04 03:33:02.433513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 221/438] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:33:02 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:03.411770 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b68b2090-2086-4e24-bf32-04b458b5a170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:03.412376 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b68b2090-2086-4e24-bf32-04b458b5a170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:03.413134 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b4a266fe-e0cc-4fbc-b56b-be0af724219a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:03.413738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b4a266fe-e0cc-4fbc-b56b-be0af724219a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:03.419335 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b68b2090-2086-4e24-bf32-04b458b5a170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:03.419856 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b68b2090-2086-4e24-bf32-04b458b5a170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:03.420310 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b68b2090-2086-4e24-bf32-04b458b5a170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:03.421001 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b68b2090-2086-4e24-bf32-04b458b5a170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:03.421477 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4a266fe-e0cc-4fbc-b56b-be0af724219a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:03.421604 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b68b2090-2086-4e24-bf32-04b458b5a170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:03.421879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b68b2090-2086-4e24-bf32-04b458b5a170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:03.422073 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4a266fe-e0cc-4fbc-b56b-be0af724219a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:03.422587 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4a266fe-e0cc-4fbc-b56b-be0af724219a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:03.423294 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4a266fe-e0cc-4fbc-b56b-be0af724219a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:03.423756 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4a266fe-e0cc-4fbc-b56b-be0af724219a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:03.424173 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4a266fe-e0cc-4fbc-b56b-be0af724219a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:03.618830 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b68b2090-2086-4e24-bf32-04b458b5a170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:03.626733 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b4a266fe-e0cc-4fbc-b56b-be0af724219a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:03.627836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b68b2090-2086-4e24-bf32-04b458b5a170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1513 microversion: 2.1 time: 0.220102 Oct 04 03:33:03.628856 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 218/439] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:03 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:03.634071 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-1d85af5a-2d7f-4778-abe4-acd3857759ea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:03.636732 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-1d85af5a-2d7f-4778-abe4-acd3857759ea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:03.643564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1d85af5a-2d7f-4778-abe4-acd3857759ea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:03.643564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1d85af5a-2d7f-4778-abe4-acd3857759ea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:03.643825 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1d85af5a-2d7f-4778-abe4-acd3857759ea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:03.644313 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1d85af5a-2d7f-4778-abe4-acd3857759ea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:03.644922 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1d85af5a-2d7f-4778-abe4-acd3857759ea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:03.645360 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1d85af5a-2d7f-4778-abe4-acd3857759ea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:03.652911 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b4a266fe-e0cc-4fbc-b56b-be0af724219a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1676 microversion: 2.1 time: 0.243476 Oct 04 03:33:03.654214 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 222/440] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:03 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:03.676891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b8640c61-62cd-44a1-adf7-68827d979e5a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34bd1673-8f25-4cf5-b752-6afd1f280af5"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:03.679270 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b8640c61-62cd-44a1-adf7-68827d979e5a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:03.681290 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-1d85af5a-2d7f-4778-abe4-acd3857759ea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050661 Oct 04 03:33:03.682921 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 219/441] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:33:03 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:03.686572 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8640c61-62cd-44a1-adf7-68827d979e5a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:03.687209 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8640c61-62cd-44a1-adf7-68827d979e5a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:03.687765 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8640c61-62cd-44a1-adf7-68827d979e5a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:03.688527 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8640c61-62cd-44a1-adf7-68827d979e5a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:03.688981 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8640c61-62cd-44a1-adf7-68827d979e5a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:03.689401 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b8640c61-62cd-44a1-adf7-68827d979e5a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:04.025055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b8640c61-62cd-44a1-adf7-68827d979e5a tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "POST /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352083 Oct 04 03:33:04.025655 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 223/442] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Oct 4 03:33:03 2022] POST /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:04.593637 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-e4482565-e772-443d-8ba9-b60b801aac6d req-3a3ad718-29c0-42c3-91af-9e79103a6aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe86068-8683-468f-a300-d8b7bac8d2c1", "name": "network-vif-deleted", "tag": "55936394-938d-4b9f-95f5-014c54fb58ab"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:04.607293 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-e4482565-e772-443d-8ba9-b60b801aac6d req-3a3ad718-29c0-42c3-91af-9e79103a6aaa service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:04.608050 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-e4482565-e772-443d-8ba9-b60b801aac6d req-3a3ad718-29c0-42c3-91af-9e79103a6aaa service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:04.608468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-e4482565-e772-443d-8ba9-b60b801aac6d req-3a3ad718-29c0-42c3-91af-9e79103a6aaa service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:04.620849 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-e4482565-e772-443d-8ba9-b60b801aac6d req-3a3ad718-29c0-42c3-91af-9e79103a6aaa service nova] Creating event network-vif-deleted:55936394-938d-4b9f-95f5-014c54fb58ab for instance 9fe86068-8683-468f-a300-d8b7bac8d2c1 on hv-cinder-84914 Oct 04 03:33:04.625923 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-e4482565-e772-443d-8ba9-b60b801aac6d req-3a3ad718-29c0-42c3-91af-9e79103a6aaa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035906 Oct 04 03:33:04.626553 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 220/443] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:04.653616 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b015de46-3c57-4c6f-bcc7-782b0a3a2157 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:04.654219 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b015de46-3c57-4c6f-bcc7-782b0a3a2157 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:04.660737 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b015de46-3c57-4c6f-bcc7-782b0a3a2157 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:04.661218 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b015de46-3c57-4c6f-bcc7-782b0a3a2157 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:04.661755 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b015de46-3c57-4c6f-bcc7-782b0a3a2157 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:04.662547 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b015de46-3c57-4c6f-bcc7-782b0a3a2157 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:04.663000 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b015de46-3c57-4c6f-bcc7-782b0a3a2157 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:04.663450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b015de46-3c57-4c6f-bcc7-782b0a3a2157 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:04.678894 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-1cf9baa7-eb45-4f80-9a4d-c78394e2b668 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:04.679622 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-1cf9baa7-eb45-4f80-9a4d-c78394e2b668 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:04.685908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1cf9baa7-eb45-4f80-9a4d-c78394e2b668 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:04.686391 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1cf9baa7-eb45-4f80-9a4d-c78394e2b668 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:04.686818 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1cf9baa7-eb45-4f80-9a4d-c78394e2b668 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:04.687530 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1cf9baa7-eb45-4f80-9a4d-c78394e2b668 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:04.688136 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1cf9baa7-eb45-4f80-9a4d-c78394e2b668 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:04.688601 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1cf9baa7-eb45-4f80-9a4d-c78394e2b668 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:04.735624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b015de46-3c57-4c6f-bcc7-782b0a3a2157 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:04.743584 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b015de46-3c57-4c6f-bcc7-782b0a3a2157 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1304 microversion: 2.1 time: 0.095666 Oct 04 03:33:04.744257 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 224/444] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:04 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:04.748855 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b5ef3e80-753d-43e9-8ca7-b0603e1ea80b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:04.751065 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b5ef3e80-753d-43e9-8ca7-b0603e1ea80b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:04.757036 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ef3e80-753d-43e9-8ca7-b0603e1ea80b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:04.757458 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ef3e80-753d-43e9-8ca7-b0603e1ea80b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:04.757896 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ef3e80-753d-43e9-8ca7-b0603e1ea80b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:04.758613 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ef3e80-753d-43e9-8ca7-b0603e1ea80b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:04.759158 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ef3e80-753d-43e9-8ca7-b0603e1ea80b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:04.759822 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ef3e80-753d-43e9-8ca7-b0603e1ea80b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:04.790835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b5ef3e80-753d-43e9-8ca7-b0603e1ea80b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044529 Oct 04 03:33:04.791388 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 225/445] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:33:04 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 03:33:04.834392 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-1cf9baa7-eb45-4f80-9a4d-c78394e2b668 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:04.842162 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-1cf9baa7-eb45-4f80-9a4d-c78394e2b668 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1653 microversion: 2.1 time: 0.167513 Oct 04 03:33:04.842734 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 221/446] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:04 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1653 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:04.855841 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2fe0cd1f-16c3-455f-ad6b-4995c678a7e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:04.856452 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2fe0cd1f-16c3-455f-ad6b-4995c678a7e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:04.862818 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2fe0cd1f-16c3-455f-ad6b-4995c678a7e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:04.863283 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2fe0cd1f-16c3-455f-ad6b-4995c678a7e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:04.863740 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2fe0cd1f-16c3-455f-ad6b-4995c678a7e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:04.863971 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d14c767b-40b2-4571-b974-350572747f42 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:04.864435 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2fe0cd1f-16c3-455f-ad6b-4995c678a7e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:04.864885 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2fe0cd1f-16c3-455f-ad6b-4995c678a7e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:04.865306 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2fe0cd1f-16c3-455f-ad6b-4995c678a7e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:04.870311 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d14c767b-40b2-4571-b974-350572747f42 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:04.870794 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d14c767b-40b2-4571-b974-350572747f42 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:04.871227 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d14c767b-40b2-4571-b974-350572747f42 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:04.890805 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2fe0cd1f-16c3-455f-ad6b-4995c678a7e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:33:04.892734 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d14c767b-40b2-4571-b974-350572747f42 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Going to try to start instance {{(pid=120595) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 03:33:04.936950 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d14c767b-40b2-4571-b974-350572747f42 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "POST /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/action" status: 202 len: 0 microversion: 2.1 time: 0.076467 Oct 04 03:33:04.937548 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 222/447] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Oct 4 03:33:04 2022] POST /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 03:33:04.946032 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f680b6b6-db5b-479a-a5f2-a675d127ce95 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:04.946783 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f680b6b6-db5b-479a-a5f2-a675d127ce95 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:04.953450 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f680b6b6-db5b-479a-a5f2-a675d127ce95 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:04.954077 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f680b6b6-db5b-479a-a5f2-a675d127ce95 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:04.954620 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f680b6b6-db5b-479a-a5f2-a675d127ce95 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:04.955320 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f680b6b6-db5b-479a-a5f2-a675d127ce95 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:04.955838 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f680b6b6-db5b-479a-a5f2-a675d127ce95 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:04.956329 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f680b6b6-db5b-479a-a5f2-a675d127ce95 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:04.974460 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2fe0cd1f-16c3-455f-ad6b-4995c678a7e9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 204 len: 0 microversion: 2.1 time: 0.122324 Oct 04 03:33:04.975394 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 226/448] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:33:04 2022] DELETE /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 03:33:04.984440 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-10e0292d-d569-451f-b171-239993a173a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:04.985298 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-10e0292d-d569-451f-b171-239993a173a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:04.990999 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10e0292d-d569-451f-b171-239993a173a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:04.991496 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10e0292d-d569-451f-b171-239993a173a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:04.991944 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10e0292d-d569-451f-b171-239993a173a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:04.992725 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10e0292d-d569-451f-b171-239993a173a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:04.993746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10e0292d-d569-451f-b171-239993a173a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:04.994185 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10e0292d-d569-451f-b171-239993a173a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:05.013228 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:05.160795 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f680b6b6-db5b-479a-a5f2-a675d127ce95 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:05.169367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f680b6b6-db5b-479a-a5f2-a675d127ce95 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1662 microversion: 2.1 time: 0.227483 Oct 04 03:33:05.169928 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 223/449] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:04 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1662 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:05.190266 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-10e0292d-d569-451f-b171-239993a173a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:05.198455 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-10e0292d-d569-451f-b171-239993a173a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1683 microversion: 2.1 time: 0.218060 Oct 04 03:33:05.199018 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 227/450] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:04 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1683 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:05.766360 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-401a5f72-0de2-4a0b-bb0b-54c1a022d170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:05.766958 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-401a5f72-0de2-4a0b-bb0b-54c1a022d170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:05.773342 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-401a5f72-0de2-4a0b-bb0b-54c1a022d170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:05.773842 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-401a5f72-0de2-4a0b-bb0b-54c1a022d170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:05.774265 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-401a5f72-0de2-4a0b-bb0b-54c1a022d170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:05.775022 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-401a5f72-0de2-4a0b-bb0b-54c1a022d170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:05.775466 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-401a5f72-0de2-4a0b-bb0b-54c1a022d170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:05.775910 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-401a5f72-0de2-4a0b-bb0b-54c1a022d170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:05.806212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-401a5f72-0de2-4a0b-bb0b-54c1a022d170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:05.806680 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-401a5f72-0de2-4a0b-bb0b-54c1a022d170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:05.807103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-401a5f72-0de2-4a0b-bb0b-54c1a022d170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:05.807556 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-401a5f72-0de2-4a0b-bb0b-54c1a022d170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lazy-loading 'fault' on Instance uuid 9fe86068-8683-468f-a300-d8b7bac8d2c1 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:33:05.846406 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-401a5f72-0de2-4a0b-bb0b-54c1a022d170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:05.854412 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-401a5f72-0de2-4a0b-bb0b-54c1a022d170 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1309 microversion: 2.1 time: 0.091831 Oct 04 03:33:05.854969 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 224/451] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:05 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:06.192695 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2e0ac167-a160-4e07-91eb-a3f5435ad1c0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:06.193603 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2e0ac167-a160-4e07-91eb-a3f5435ad1c0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:06.200155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e0ac167-a160-4e07-91eb-a3f5435ad1c0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:06.200639 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e0ac167-a160-4e07-91eb-a3f5435ad1c0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:06.201070 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e0ac167-a160-4e07-91eb-a3f5435ad1c0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:06.201760 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e0ac167-a160-4e07-91eb-a3f5435ad1c0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:06.202206 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e0ac167-a160-4e07-91eb-a3f5435ad1c0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:06.202624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e0ac167-a160-4e07-91eb-a3f5435ad1c0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:06.221532 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-78ca3662-2631-4395-8990-7fa191413020 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:06.222245 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-78ca3662-2631-4395-8990-7fa191413020 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:06.229266 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-78ca3662-2631-4395-8990-7fa191413020 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:06.229813 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-78ca3662-2631-4395-8990-7fa191413020 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:06.230305 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-78ca3662-2631-4395-8990-7fa191413020 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:06.231049 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-78ca3662-2631-4395-8990-7fa191413020 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:06.231607 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-78ca3662-2631-4395-8990-7fa191413020 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:06.232098 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-78ca3662-2631-4395-8990-7fa191413020 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:06.403126 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2e0ac167-a160-4e07-91eb-a3f5435ad1c0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:06.407708 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-78ca3662-2631-4395-8990-7fa191413020 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:06.410749 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2e0ac167-a160-4e07-91eb-a3f5435ad1c0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1662 microversion: 2.1 time: 0.222499 Oct 04 03:33:06.411314 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 228/452] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:06 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1662 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:06.415604 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-78ca3662-2631-4395-8990-7fa191413020 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1683 microversion: 2.1 time: 0.197767 Oct 04 03:33:06.416113 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 225/453] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:06 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:06.877903 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0376a0a2-00fd-4d7b-be45-10e61f717a92 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:06.878510 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0376a0a2-00fd-4d7b-be45-10e61f717a92 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:06.884661 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0376a0a2-00fd-4d7b-be45-10e61f717a92 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:06.885141 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0376a0a2-00fd-4d7b-be45-10e61f717a92 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:06.885573 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0376a0a2-00fd-4d7b-be45-10e61f717a92 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:06.886261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0376a0a2-00fd-4d7b-be45-10e61f717a92 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:06.886711 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0376a0a2-00fd-4d7b-be45-10e61f717a92 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:06.887133 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0376a0a2-00fd-4d7b-be45-10e61f717a92 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:06.918887 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0376a0a2-00fd-4d7b-be45-10e61f717a92 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:06.919364 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0376a0a2-00fd-4d7b-be45-10e61f717a92 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:06.919832 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0376a0a2-00fd-4d7b-be45-10e61f717a92 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:06.920277 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-0376a0a2-00fd-4d7b-be45-10e61f717a92 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lazy-loading 'fault' on Instance uuid 9fe86068-8683-468f-a300-d8b7bac8d2c1 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:33:06.963165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-0376a0a2-00fd-4d7b-be45-10e61f717a92 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:06.971128 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0376a0a2-00fd-4d7b-be45-10e61f717a92 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 200 len: 1309 microversion: 2.1 time: 0.097101 Oct 04 03:33:06.971943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 229/454] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:06 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:07.363830 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e5eb9b8a-092e-40c4-ad2b-368036d96787 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:07.366243 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e5eb9b8a-092e-40c4-ad2b-368036d96787 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:07.373939 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e5eb9b8a-092e-40c4-ad2b-368036d96787 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:07.374417 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e5eb9b8a-092e-40c4-ad2b-368036d96787 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:07.374965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e5eb9b8a-092e-40c4-ad2b-368036d96787 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:07.375689 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e5eb9b8a-092e-40c4-ad2b-368036d96787 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:07.376138 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e5eb9b8a-092e-40c4-ad2b-368036d96787 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:07.376557 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e5eb9b8a-092e-40c4-ad2b-368036d96787 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:07.401541 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-e5eb9b8a-092e-40c4-ad2b-368036d96787 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lazy-loading 'flavor' on Instance uuid 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:33:07.435730 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1a753fdb-cec7-4c48-adca-ac06d80fae8f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:07.438542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1a753fdb-cec7-4c48-adca-ac06d80fae8f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:07.445628 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a753fdb-cec7-4c48-adca-ac06d80fae8f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:07.446248 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a753fdb-cec7-4c48-adca-ac06d80fae8f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:07.447083 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a753fdb-cec7-4c48-adca-ac06d80fae8f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:07.447934 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a753fdb-cec7-4c48-adca-ac06d80fae8f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:07.448497 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a753fdb-cec7-4c48-adca-ac06d80fae8f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:07.448988 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a753fdb-cec7-4c48-adca-ac06d80fae8f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:07.544744 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e5eb9b8a-092e-40c4-ad2b-368036d96787 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "POST /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/action" status: 200 len: 32 microversion: 2.1 time: 0.184838 Oct 04 03:33:07.545364 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 226/455] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Oct 4 03:33:07 2022] POST /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 03:33:07.550779 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-71368353-a179-4a12-b140-71f1b8eda2b7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:07.551518 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-71368353-a179-4a12-b140-71f1b8eda2b7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:07.558838 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-71368353-a179-4a12-b140-71f1b8eda2b7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:07.559471 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-71368353-a179-4a12-b140-71f1b8eda2b7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:07.559936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-71368353-a179-4a12-b140-71f1b8eda2b7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:07.560648 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-71368353-a179-4a12-b140-71f1b8eda2b7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:07.561110 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-71368353-a179-4a12-b140-71f1b8eda2b7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:07.561536 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-71368353-a179-4a12-b140-71f1b8eda2b7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:08.029963 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1a753fdb-cec7-4c48-adca-ac06d80fae8f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:08.040843 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1a753fdb-cec7-4c48-adca-ac06d80fae8f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1662 microversion: 2.1 time: 0.609524 Oct 04 03:33:08.042673 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 230/456] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:07 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1662 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:08.048100 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b29128cc-bf37-4f7d-8422-32a6ebd188ae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:08.048832 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b29128cc-bf37-4f7d-8422-32a6ebd188ae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:08.054820 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b29128cc-bf37-4f7d-8422-32a6ebd188ae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:08.056058 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b29128cc-bf37-4f7d-8422-32a6ebd188ae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:08.056732 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b29128cc-bf37-4f7d-8422-32a6ebd188ae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:08.057673 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b29128cc-bf37-4f7d-8422-32a6ebd188ae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:08.057964 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-71368353-a179-4a12-b140-71f1b8eda2b7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:08.058632 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b29128cc-bf37-4f7d-8422-32a6ebd188ae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:08.059062 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b29128cc-bf37-4f7d-8422-32a6ebd188ae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:08.067542 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-71368353-a179-4a12-b140-71f1b8eda2b7 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1683 microversion: 2.1 time: 0.520475 Oct 04 03:33:08.069140 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 227/457] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:07 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1683 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:08.075196 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-32313ce0-a841-41ad-9980-743ce995ed7e tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:08.075833 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-32313ce0-a841-41ad-9980-743ce995ed7e tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: 9fe86068-8683-468f-a300-d8b7bac8d2c1] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:08.083514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-32313ce0-a841-41ad-9980-743ce995ed7e tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:08.084009 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-32313ce0-a841-41ad-9980-743ce995ed7e tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:08.084447 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-32313ce0-a841-41ad-9980-743ce995ed7e tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:08.085142 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-32313ce0-a841-41ad-9980-743ce995ed7e tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:08.085590 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-32313ce0-a841-41ad-9980-743ce995ed7e tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:08.086013 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-32313ce0-a841-41ad-9980-743ce995ed7e tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:08.104010 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-32313ce0-a841-41ad-9980-743ce995ed7e tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] HTTP exception thrown: Instance 9fe86068-8683-468f-a300-d8b7bac8d2c1 could not be found. Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-32313ce0-a841-41ad-9980-743ce995ed7e tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Request method failure captured: Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 HTTP/1.1 Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6kpxXMJUFZ-lQQqomt5XJ6YLolAnOn2o7U2SVDM-q9puJWC2FTJMzbRHBkro9NS_dAbqng1pd_rnQIwRGgU0glNUh135EpweIZFebAwy5Qsr35GU0iU5GC5ZkcG2X_Jh7xL5JlDJMEF-y61aj_x5ejPYD0iSaBI6XIqqtDVwPc8XEs Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 3edbcf8484374dab9697bab576e6afdb Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-VolumesSnapshotTestJSON-605500478 Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:33:08.105650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:33:08.106974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3edbcf8484374dab9697bab576e6afdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3edbcf8484374dab9697bab576e6afdb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3edbcf8484374dab9697bab576e6afdb", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3edbcf8484374dab9697bab576e6afdb"}]}] Oct 04 03:33:08.106974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-VolumesSnapshotTestJSON-605500478 Oct 04 03:33:08.106974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 3edbcf8484374dab9697bab576e6afdb Oct 04 03:33:08.106974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-605500478 Oct 04 03:33:08.106974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-VolumesSnapshotTestJSON-605500478-project Oct 04 03:33:08.106974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:33:08.106974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:33:08.106974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 4d1b67fec65345d3b7973445eab896b2 Oct 04 03:33:08.106974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-VolumesSnapshotTestJSON-605500478-project Oct 04 03:33:08.106974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:33:08.106974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance 9fe86068-8683-468f-a300-d8b7bac8d2c1 could not be found. Oct 04 03:33:08.106974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '9fe86068-8683-468f-a300-d8b7bac8d2c1'} Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe86068-8683-468f-a300-d8b7bac8d2c1 could not be found. Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:33:08.107772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe86068-8683-468f-a300-d8b7bac8d2c1 could not be found. Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe86068-8683-468f-a300-d8b7bac8d2c1 could not be found. Oct 04 03:33:08.108963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:33:08.109973 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-32313ce0-a841-41ad-9980-743ce995ed7e tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Returning 404 to user: Instance 9fe86068-8683-468f-a300-d8b7bac8d2c1 could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:33:08.109973 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-32313ce0-a841-41ad-9980-743ce995ed7e tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1" status: 404 len: 111 microversion: 2.1 time: 0.036911 Oct 04 03:33:08.109973 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 228/458] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:08 2022] GET /compute/v2.1/servers/9fe86068-8683-468f-a300-d8b7bac8d2c1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:33:08.346089 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b29128cc-bf37-4f7d-8422-32a6ebd188ae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:08.354885 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b29128cc-bf37-4f7d-8422-32a6ebd188ae tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.310983 Oct 04 03:33:08.355645 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 231/459] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:08 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:08.862754 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-e4eca785-50a8-4218-b670-0ca79d8fb94e req-b13b8413-412e-4243-a3a1-bd1fa47a7334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79803288-b24a-4fcd-9ed9-b08111250cc5", "name": "network-vif-deleted", "tag": "1af39c75-2f24-46f5-9b6f-18624935b4cc"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:08.873734 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-e4eca785-50a8-4218-b670-0ca79d8fb94e req-b13b8413-412e-4243-a3a1-bd1fa47a7334 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:08.874214 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-e4eca785-50a8-4218-b670-0ca79d8fb94e req-b13b8413-412e-4243-a3a1-bd1fa47a7334 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:08.874639 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-e4eca785-50a8-4218-b670-0ca79d8fb94e req-b13b8413-412e-4243-a3a1-bd1fa47a7334 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:08.888028 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-e4eca785-50a8-4218-b670-0ca79d8fb94e req-b13b8413-412e-4243-a3a1-bd1fa47a7334 service nova] Creating event network-vif-deleted:1af39c75-2f24-46f5-9b6f-18624935b4cc for instance 79803288-b24a-4fcd-9ed9-b08111250cc5 on hv-cinder-84914 Oct 04 03:33:08.892814 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-e4eca785-50a8-4218-b670-0ca79d8fb94e req-b13b8413-412e-4243-a3a1-bd1fa47a7334 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033742 Oct 04 03:33:08.893407 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 229/460] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:09.065198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e915ccb5-0cca-48cb-a177-6ba4ce93ffa2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:09.066427 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e915ccb5-0cca-48cb-a177-6ba4ce93ffa2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:09.074185 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e915ccb5-0cca-48cb-a177-6ba4ce93ffa2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:09.074860 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e915ccb5-0cca-48cb-a177-6ba4ce93ffa2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:09.075292 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e915ccb5-0cca-48cb-a177-6ba4ce93ffa2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:09.076283 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e915ccb5-0cca-48cb-a177-6ba4ce93ffa2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:09.076831 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e915ccb5-0cca-48cb-a177-6ba4ce93ffa2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:09.077146 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e915ccb5-0cca-48cb-a177-6ba4ce93ffa2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:09.096335 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e4d92f80-3dee-4790-a24e-efdf77f1a6bd tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:09.097197 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e4d92f80-3dee-4790-a24e-efdf77f1a6bd tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:09.103543 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4d92f80-3dee-4790-a24e-efdf77f1a6bd tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:09.104139 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4d92f80-3dee-4790-a24e-efdf77f1a6bd tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:09.104820 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4d92f80-3dee-4790-a24e-efdf77f1a6bd tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:09.105742 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4d92f80-3dee-4790-a24e-efdf77f1a6bd tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:09.106391 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4d92f80-3dee-4790-a24e-efdf77f1a6bd tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:09.107011 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4d92f80-3dee-4790-a24e-efdf77f1a6bd tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:09.146199 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4d92f80-3dee-4790-a24e-efdf77f1a6bd tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:09.146933 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4d92f80-3dee-4790-a24e-efdf77f1a6bd tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:09.147566 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4d92f80-3dee-4790-a24e-efdf77f1a6bd tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:09.148166 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-e4d92f80-3dee-4790-a24e-efdf77f1a6bd tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lazy-loading 'fault' on Instance uuid 79803288-b24a-4fcd-9ed9-b08111250cc5 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:33:09.198227 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e4d92f80-3dee-4790-a24e-efdf77f1a6bd tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:09.206145 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e4d92f80-3dee-4790-a24e-efdf77f1a6bd tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 200 len: 1332 microversion: 2.1 time: 0.114296 Oct 04 03:33:09.207130 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 230/461] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:09 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:09.233457 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e915ccb5-0cca-48cb-a177-6ba4ce93ffa2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:09.241338 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e915ccb5-0cca-48cb-a177-6ba4ce93ffa2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1662 microversion: 2.1 time: 0.179921 Oct 04 03:33:09.241906 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 232/462] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:09 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1662 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:09.379840 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b6305e82-b820-4bfe-bf70-44199e768522 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:09.380718 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b6305e82-b820-4bfe-bf70-44199e768522 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:09.386924 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b6305e82-b820-4bfe-bf70-44199e768522 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:09.387413 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b6305e82-b820-4bfe-bf70-44199e768522 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:09.387878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b6305e82-b820-4bfe-bf70-44199e768522 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:09.388569 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b6305e82-b820-4bfe-bf70-44199e768522 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:09.389246 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b6305e82-b820-4bfe-bf70-44199e768522 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:09.389707 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b6305e82-b820-4bfe-bf70-44199e768522 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:09.537740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b6305e82-b820-4bfe-bf70-44199e768522 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:09.541791 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:09.550117 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b6305e82-b820-4bfe-bf70-44199e768522 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.174223 Oct 04 03:33:09.551263 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 231/463] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:09 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:10.230434 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-072870fe-d8b3-4620-9489-ac39b96308a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:10.231090 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-072870fe-d8b3-4620-9489-ac39b96308a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:10.237563 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-072870fe-d8b3-4620-9489-ac39b96308a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:10.238039 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-072870fe-d8b3-4620-9489-ac39b96308a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:10.238466 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-072870fe-d8b3-4620-9489-ac39b96308a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:10.239198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-072870fe-d8b3-4620-9489-ac39b96308a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:10.239686 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-072870fe-d8b3-4620-9489-ac39b96308a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:10.240103 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-072870fe-d8b3-4620-9489-ac39b96308a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:10.254208 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-072870fe-d8b3-4620-9489-ac39b96308a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] HTTP exception thrown: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-072870fe-d8b3-4620-9489-ac39b96308a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Request method failure captured: Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 HTTP/1.1 Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6isUYhgYsAb2pqxJ5i2_6gzGtKyJzLe2quMbLKiFrXtrxQIhaAv2XwsUqEAkN7Fh1WqlIXaqgH_JRfN3W7XWKG2TyqZRi_OBW_0jILA2kaoQ2SSAvWUeuuoQxbaW7Q90VlSmfhWYx2fgtTX4JS2Hb0X2tvDyvvlYbTndLm_mtGSa4s Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:33:10.255851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:33:10.257335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d6ee89cb464afa95e222b2a1e7279b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d6ee89cb464afa95e222b2a1e7279b"}]}] Oct 04 03:33:10.257335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:33:10.257335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:33:10.257335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:33:10.257335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:33:10.257335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:33:10.257335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:33:10.257335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: b8795829c34046628cae345dd4d45e75 Oct 04 03:33:10.257335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:33:10.257335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:33:10.257335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:33:10.257335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '79803288-b24a-4fcd-9ed9-b08111250cc5'} Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:33:10.258155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:33:10.260467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:33:10.261766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-072870fe-d8b3-4620-9489-ac39b96308a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Returning 404 to user: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:33:10.261766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-072870fe-d8b3-4620-9489-ac39b96308a0 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 404 len: 111 microversion: 2.1 time: 0.030924 Oct 04 03:33:10.261766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 233/464] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:10 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:33:10.268087 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6124e0c3-64d5-436a-99ca-d21436bc7227 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '.version_select at 0x7f165b7073a0>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:10.268591 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3b6b76f6-2a34-4eb2-9f7e-d6403c9056a9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:10.268929 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3b6b76f6-2a34-4eb2-9f7e-d6403c9056a9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:10.276614 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b6b76f6-2a34-4eb2-9f7e-d6403c9056a9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:10.277134 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b6b76f6-2a34-4eb2-9f7e-d6403c9056a9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:10.277780 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b6b76f6-2a34-4eb2-9f7e-d6403c9056a9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:10.278689 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b6b76f6-2a34-4eb2-9f7e-d6403c9056a9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:10.279134 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b6b76f6-2a34-4eb2-9f7e-d6403c9056a9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:10.279575 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b6b76f6-2a34-4eb2-9f7e-d6403c9056a9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:10.287844 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6124e0c3-64d5-436a-99ca-d21436bc7227 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2053772902" status: 202 len: 0 microversion: 2.1 time: 0.024676 Oct 04 03:33:10.288418 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 232/465] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Oct 4 03:33:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2053772902 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 03:33:10.412563 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-3b6b76f6-2a34-4eb2-9f7e-d6403c9056a9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:10.421829 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3b6b76f6-2a34-4eb2-9f7e-d6403c9056a9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1666 microversion: 2.1 time: 0.157519 Oct 04 03:33:10.422514 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 234/466] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:10 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:10.575745 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-16e8a0fa-a0fa-4dc2-a15c-c5788745b4a2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:10.576387 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-16e8a0fa-a0fa-4dc2-a15c-c5788745b4a2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:10.582490 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-16e8a0fa-a0fa-4dc2-a15c-c5788745b4a2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:10.582967 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-16e8a0fa-a0fa-4dc2-a15c-c5788745b4a2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:10.583405 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-16e8a0fa-a0fa-4dc2-a15c-c5788745b4a2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:10.584203 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-16e8a0fa-a0fa-4dc2-a15c-c5788745b4a2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:10.585289 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-16e8a0fa-a0fa-4dc2-a15c-c5788745b4a2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:10.585715 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-16e8a0fa-a0fa-4dc2-a15c-c5788745b4a2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:10.813872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-16e8a0fa-a0fa-4dc2-a15c-c5788745b4a2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:10.823041 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-16e8a0fa-a0fa-4dc2-a15c-c5788745b4a2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.252496 Oct 04 03:33:10.823710 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 233/467] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:10 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:11.025942 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-09c0b8c7-a04c-4768-888e-544e3b3976db tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Action: 'create', calling method: .version_select at 0x7f165b485ee0>, body: {"keypair": {"name": "tempest-keypair-641844043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFRx3zvaXenbJ1DZquekMs7/uQUs3ItEKpj9MzgsH6rVrBFLrraequicNftYFGQnSmepUJbOm7gPRuctbe5z4638Ej/TfIaQwywhlGz0ODYJiZVpHuJ1750KurHzHhgFQ=="}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:11.041731 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-09c0b8c7-a04c-4768-888e-544e3b3976db tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:33:11.045448 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-09c0b8c7-a04c-4768-888e-544e3b3976db tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for user b8795829c34046628cae345dd4d45e75 and project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:33:11.070168 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-09c0b8c7-a04c-4768-888e-544e3b3976db tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048151 Oct 04 03:33:11.070756 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 235/468] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Oct 4 03:33:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:11.849912 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-542fae34-4a15-41ff-9783-44527c9ee260 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:11.850747 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-542fae34-4a15-41ff-9783-44527c9ee260 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:11.858951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-542fae34-4a15-41ff-9783-44527c9ee260 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:11.859817 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-542fae34-4a15-41ff-9783-44527c9ee260 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:11.860499 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-542fae34-4a15-41ff-9783-44527c9ee260 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:11.861246 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-542fae34-4a15-41ff-9783-44527c9ee260 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:11.861823 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-542fae34-4a15-41ff-9783-44527c9ee260 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:11.862236 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-542fae34-4a15-41ff-9783-44527c9ee260 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:11.944767 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1536115281", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "networks": [{"uuid": "2e050f8e-f47a-49fb-bab9-f88f333ac543"}]}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:12.000511 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] validate_networks() for [('2e050f8e-f47a-49fb-bab9-f88f333ac543', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:33:12.129512 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-542fae34-4a15-41ff-9783-44527c9ee260 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:12.138227 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-542fae34-4a15-41ff-9783-44527c9ee260 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.293030 Oct 04 03:33:12.138900 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 234/469] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:11 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:12.824206 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:33:12.824536 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:33:12.825001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:33:12.825400 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:33:12.825806 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:33:12.834393 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:12.834868 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:12.835292 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:12.836042 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:12.836811 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:12.837261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:12.855631 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Getting quotas for project 3edbcf8484374dab9697bab576e6afdb. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:33:12.859612 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Getting quotas for user 4d1b67fec65345d3b7973445eab896b2 and project 3edbcf8484374dab9697bab576e6afdb. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:33:12.871130 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:33:12.873629 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:33:12.907989 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1030492185", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "86d4958b-fe69-4a74-b4b0-c186c2f360dd"}], "security_groups": [{"name": "tempest-securitygroup--467771829"}], "key_name": "tempest-keypair-641844043", "user_data": "}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:12.921000 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a2ac63a1-4614-48ce-82f4-5b48b55fb7f1 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980705 Oct 04 03:33:12.921884 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 236/470] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:33:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 03:33:12.933259 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-61fb50aa-a910-46ac-be40-22077501423a tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:12.933859 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-61fb50aa-a910-46ac-be40-22077501423a tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:12.995674 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-61fb50aa-a910-46ac-be40-22077501423a tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:13.003116 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-61fb50aa-a910-46ac-be40-22077501423a tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1219 microversion: 2.1 time: 0.074141 Oct 04 03:33:13.003797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 237/471] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:12 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:13.036276 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.network.neutron [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] validate_networks() for [('86d4958b-fe69-4a74-b4b0-c186c2f360dd', None, None, None, None, None)] {{(pid=120595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:33:13.162805 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5c498ea0-e8ac-4e16-b195-e84e425af99f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:13.163457 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5c498ea0-e8ac-4e16-b195-e84e425af99f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:13.170542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5c498ea0-e8ac-4e16-b195-e84e425af99f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:13.171412 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5c498ea0-e8ac-4e16-b195-e84e425af99f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:13.171993 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5c498ea0-e8ac-4e16-b195-e84e425af99f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:13.175762 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5c498ea0-e8ac-4e16-b195-e84e425af99f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:13.176512 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5c498ea0-e8ac-4e16-b195-e84e425af99f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:13.177081 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5c498ea0-e8ac-4e16-b195-e84e425af99f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:13.416426 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5c498ea0-e8ac-4e16-b195-e84e425af99f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:13.426824 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5c498ea0-e8ac-4e16-b195-e84e425af99f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.268374 Oct 04 03:33:13.427529 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 238/472] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:13 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:13.488049 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Flavor limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:33:13.488688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Image limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:33:13.489537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Flavor pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:33:13.490267 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Image pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:33:13.492090 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:33:13.501346 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:13.502111 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:13.502633 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:13.503418 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:13.503968 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:13.504469 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:13.521605 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:33:13.525770 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for user b8795829c34046628cae345dd4d45e75 and project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:33:13.536812 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Going to run 1 instances... {{(pid=120595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:33:13.539079 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:33:13.560346 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:13.588049 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-de51703a-6d91-45b9-b075-d9a698cc3adb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.684514 Oct 04 03:33:13.588906 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 235/473] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:33:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 03:33:13.599895 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ab125687-5dfe-46ff-974a-7b58956c6460 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:13.600621 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ab125687-5dfe-46ff-974a-7b58956c6460 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:13.668074 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ab125687-5dfe-46ff-974a-7b58956c6460 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:13.675240 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ab125687-5dfe-46ff-974a-7b58956c6460 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1241 microversion: 2.1 time: 0.079188 Oct 04 03:33:13.676015 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 239/474] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:13 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:14.026389 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c8b0330f-3437-4ddd-9f2a-101dd5cb88ef tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:14.027019 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c8b0330f-3437-4ddd-9f2a-101dd5cb88ef tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:14.034701 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c8b0330f-3437-4ddd-9f2a-101dd5cb88ef tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:14.035188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c8b0330f-3437-4ddd-9f2a-101dd5cb88ef tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:14.035655 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c8b0330f-3437-4ddd-9f2a-101dd5cb88ef tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:14.036337 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c8b0330f-3437-4ddd-9f2a-101dd5cb88ef tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:14.036786 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c8b0330f-3437-4ddd-9f2a-101dd5cb88ef tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:14.037209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c8b0330f-3437-4ddd-9f2a-101dd5cb88ef tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:14.097278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c8b0330f-3437-4ddd-9f2a-101dd5cb88ef tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:14.105862 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c8b0330f-3437-4ddd-9f2a-101dd5cb88ef tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1271 microversion: 2.1 time: 0.084036 Oct 04 03:33:14.106623 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 236/475] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:14 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:14.452942 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-47bba582-5e12-482e-b2ce-d960c5b848e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:14.453490 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-47bba582-5e12-482e-b2ce-d960c5b848e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:14.460092 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-47bba582-5e12-482e-b2ce-d960c5b848e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:14.460620 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-47bba582-5e12-482e-b2ce-d960c5b848e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:14.461441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-47bba582-5e12-482e-b2ce-d960c5b848e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:14.462303 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-47bba582-5e12-482e-b2ce-d960c5b848e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:14.462760 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-47bba582-5e12-482e-b2ce-d960c5b848e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:14.463187 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-47bba582-5e12-482e-b2ce-d960c5b848e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:14.670965 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-47bba582-5e12-482e-b2ce-d960c5b848e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:14.679374 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-47bba582-5e12-482e-b2ce-d960c5b848e2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.230333 Oct 04 03:33:14.679973 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 240/476] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:14 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:14.699362 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9467eec5-cbfd-49dd-972a-6d98bd79891b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:14.700483 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-9467eec5-cbfd-49dd-972a-6d98bd79891b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:14.706533 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9467eec5-cbfd-49dd-972a-6d98bd79891b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:14.706974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9467eec5-cbfd-49dd-972a-6d98bd79891b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:14.707401 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9467eec5-cbfd-49dd-972a-6d98bd79891b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:14.708190 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9467eec5-cbfd-49dd-972a-6d98bd79891b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:14.708644 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9467eec5-cbfd-49dd-972a-6d98bd79891b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:14.709077 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9467eec5-cbfd-49dd-972a-6d98bd79891b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:14.799005 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-9467eec5-cbfd-49dd-972a-6d98bd79891b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:14.807514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-9467eec5-cbfd-49dd-972a-6d98bd79891b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1293 microversion: 2.1 time: 0.112825 Oct 04 03:33:14.808082 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 237/477] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:14 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1293 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:15.130961 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-41d7ad97-2437-4964-8aeb-852ef6e95ddd tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:15.132053 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-41d7ad97-2437-4964-8aeb-852ef6e95ddd tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:15.138945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41d7ad97-2437-4964-8aeb-852ef6e95ddd tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:15.139439 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41d7ad97-2437-4964-8aeb-852ef6e95ddd tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:15.139973 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41d7ad97-2437-4964-8aeb-852ef6e95ddd tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:15.140724 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41d7ad97-2437-4964-8aeb-852ef6e95ddd tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:15.141168 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41d7ad97-2437-4964-8aeb-852ef6e95ddd tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:15.141609 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41d7ad97-2437-4964-8aeb-852ef6e95ddd tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:15.475445 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-41d7ad97-2437-4964-8aeb-852ef6e95ddd tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:15.484454 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-41d7ad97-2437-4964-8aeb-852ef6e95ddd tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1319 microversion: 2.1 time: 0.358889 Oct 04 03:33:15.485020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 241/478] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:15 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:15.708414 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-33089fdd-9da1-4b9d-be0f-7accf156e7db tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:15.709029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-33089fdd-9da1-4b9d-be0f-7accf156e7db tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:15.716143 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33089fdd-9da1-4b9d-be0f-7accf156e7db tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:15.716632 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33089fdd-9da1-4b9d-be0f-7accf156e7db tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:15.717069 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33089fdd-9da1-4b9d-be0f-7accf156e7db tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:15.717765 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33089fdd-9da1-4b9d-be0f-7accf156e7db tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:15.718215 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33089fdd-9da1-4b9d-be0f-7accf156e7db tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:15.718639 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-33089fdd-9da1-4b9d-be0f-7accf156e7db tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:15.830091 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-883cbc8e-e616-4b6a-b034-1ee0119abbca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:15.830732 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-883cbc8e-e616-4b6a-b034-1ee0119abbca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:15.837427 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-883cbc8e-e616-4b6a-b034-1ee0119abbca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:15.837909 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-883cbc8e-e616-4b6a-b034-1ee0119abbca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:15.838348 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-883cbc8e-e616-4b6a-b034-1ee0119abbca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:15.839121 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-883cbc8e-e616-4b6a-b034-1ee0119abbca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:15.839549 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-883cbc8e-e616-4b6a-b034-1ee0119abbca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:15.839994 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-883cbc8e-e616-4b6a-b034-1ee0119abbca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:15.975112 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-883cbc8e-e616-4b6a-b034-1ee0119abbca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:15.985974 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-883cbc8e-e616-4b6a-b034-1ee0119abbca tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1299 microversion: 2.1 time: 0.159503 Oct 04 03:33:15.986640 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 242/479] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:15 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1299 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:16.097250 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-33089fdd-9da1-4b9d-be0f-7accf156e7db tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:16.106460 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-33089fdd-9da1-4b9d-be0f-7accf156e7db tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.401893 Oct 04 03:33:16.107611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 238/480] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:15 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:16.432584 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-f1617c2d-b029-4d41-9dfd-7c5d9ad7fbff req-cfdb0f13-1239-447d-a5d0-7040f5c9e9eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd62e87-038e-4701-a33e-81e924d68abd", "tag": "4e655acc-1939-4263-a840-6575212375cd"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:16.448397 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f1617c2d-b029-4d41-9dfd-7c5d9ad7fbff req-cfdb0f13-1239-447d-a5d0-7040f5c9e9eb service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:16.448967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f1617c2d-b029-4d41-9dfd-7c5d9ad7fbff req-cfdb0f13-1239-447d-a5d0-7040f5c9e9eb service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:16.450311 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f1617c2d-b029-4d41-9dfd-7c5d9ad7fbff req-cfdb0f13-1239-447d-a5d0-7040f5c9e9eb service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:16.468784 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-f1617c2d-b029-4d41-9dfd-7c5d9ad7fbff req-cfdb0f13-1239-447d-a5d0-7040f5c9e9eb service nova] Creating event network-changed:4e655acc-1939-4263-a840-6575212375cd for instance fbd62e87-038e-4701-a33e-81e924d68abd on hv-cinder-84914 Oct 04 03:33:16.474897 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-f1617c2d-b029-4d41-9dfd-7c5d9ad7fbff req-cfdb0f13-1239-447d-a5d0-7040f5c9e9eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047391 Oct 04 03:33:16.475984 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 243/481] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:16.509183 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-ac659966-8ae4-4b56-aee2-8f84d9968986 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:16.510232 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-ac659966-8ae4-4b56-aee2-8f84d9968986 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:16.516415 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ac659966-8ae4-4b56-aee2-8f84d9968986 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:16.516904 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ac659966-8ae4-4b56-aee2-8f84d9968986 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:16.517342 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ac659966-8ae4-4b56-aee2-8f84d9968986 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:16.518035 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ac659966-8ae4-4b56-aee2-8f84d9968986 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:16.518484 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ac659966-8ae4-4b56-aee2-8f84d9968986 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:16.518912 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ac659966-8ae4-4b56-aee2-8f84d9968986 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:16.784556 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-ac659966-8ae4-4b56-aee2-8f84d9968986 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:16.792279 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-ac659966-8ae4-4b56-aee2-8f84d9968986 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1319 microversion: 2.1 time: 0.287495 Oct 04 03:33:16.792835 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 239/482] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:16 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:17.009244 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8a7509f6-4234-4639-8b43-16117fe8b70b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:17.009956 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8a7509f6-4234-4639-8b43-16117fe8b70b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:17.016479 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a7509f6-4234-4639-8b43-16117fe8b70b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:17.016969 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a7509f6-4234-4639-8b43-16117fe8b70b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:17.017405 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a7509f6-4234-4639-8b43-16117fe8b70b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:17.018112 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a7509f6-4234-4639-8b43-16117fe8b70b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:17.018567 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a7509f6-4234-4639-8b43-16117fe8b70b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:17.018986 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a7509f6-4234-4639-8b43-16117fe8b70b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:17.130661 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-4297dd0a-424f-47dd-9fdf-14b666ceea42 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:17.131367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-4297dd0a-424f-47dd-9fdf-14b666ceea42 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:17.138384 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4297dd0a-424f-47dd-9fdf-14b666ceea42 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:17.138966 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4297dd0a-424f-47dd-9fdf-14b666ceea42 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:17.139459 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4297dd0a-424f-47dd-9fdf-14b666ceea42 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:17.140187 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4297dd0a-424f-47dd-9fdf-14b666ceea42 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:17.140633 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4297dd0a-424f-47dd-9fdf-14b666ceea42 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:17.141050 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4297dd0a-424f-47dd-9fdf-14b666ceea42 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:17.543692 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4297dd0a-424f-47dd-9fdf-14b666ceea42 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:17.552023 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-4297dd0a-424f-47dd-9fdf-14b666ceea42 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.425297 Oct 04 03:33:17.552583 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 240/483] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:17 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:17.559923 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-8a7509f6-4234-4639-8b43-16117fe8b70b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:17.568075 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8a7509f6-4234-4639-8b43-16117fe8b70b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1366 microversion: 2.1 time: 0.563171 Oct 04 03:33:17.569315 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 244/484] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:17 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1366 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:17.816551 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-5de7c041-3a92-49ee-82c7-08879a815f9d tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:17.817092 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-5de7c041-3a92-49ee-82c7-08879a815f9d tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:17.824631 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5de7c041-3a92-49ee-82c7-08879a815f9d tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:17.825114 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5de7c041-3a92-49ee-82c7-08879a815f9d tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:17.825548 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5de7c041-3a92-49ee-82c7-08879a815f9d tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:17.826245 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5de7c041-3a92-49ee-82c7-08879a815f9d tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:17.826695 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5de7c041-3a92-49ee-82c7-08879a815f9d tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:17.827117 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5de7c041-3a92-49ee-82c7-08879a815f9d tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:18.005070 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-5de7c041-3a92-49ee-82c7-08879a815f9d tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:18.013209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-5de7c041-3a92-49ee-82c7-08879a815f9d tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1319 microversion: 2.1 time: 0.200647 Oct 04 03:33:18.013785 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 241/485] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:17 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:18.496974 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-f145a346-a968-4997-bb83-1f63099dede5 req-a6cb4669-c984-4b6c-b5f6-2848b266f4be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa285589-057b-4a56-9da5-614e561bb64b", "tag": "2894bf1c-f43d-482f-921b-831aac745902"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:18.506185 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f145a346-a968-4997-bb83-1f63099dede5 req-a6cb4669-c984-4b6c-b5f6-2848b266f4be service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:18.506652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f145a346-a968-4997-bb83-1f63099dede5 req-a6cb4669-c984-4b6c-b5f6-2848b266f4be service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:18.507073 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f145a346-a968-4997-bb83-1f63099dede5 req-a6cb4669-c984-4b6c-b5f6-2848b266f4be service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:18.518642 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-f145a346-a968-4997-bb83-1f63099dede5 req-a6cb4669-c984-4b6c-b5f6-2848b266f4be service nova] Creating event network-changed:2894bf1c-f43d-482f-921b-831aac745902 for instance fa285589-057b-4a56-9da5-614e561bb64b on hv-cinder-84914 Oct 04 03:33:18.523203 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-f145a346-a968-4997-bb83-1f63099dede5 req-a6cb4669-c984-4b6c-b5f6-2848b266f4be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032074 Oct 04 03:33:18.523870 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 245/486] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:18.578217 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-973b685b-5f8f-4c4c-8485-d835582977b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:18.578860 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-973b685b-5f8f-4c4c-8485-d835582977b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:18.585906 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-973b685b-5f8f-4c4c-8485-d835582977b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:18.586449 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-973b685b-5f8f-4c4c-8485-d835582977b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:18.589016 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-973b685b-5f8f-4c4c-8485-d835582977b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:18.589756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-973b685b-5f8f-4c4c-8485-d835582977b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:18.590222 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-973b685b-5f8f-4c4c-8485-d835582977b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:18.590651 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-973b685b-5f8f-4c4c-8485-d835582977b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:18.594573 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bcf47289-5cbb-446b-b3af-523fc3ac068d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:18.595275 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bcf47289-5cbb-446b-b3af-523fc3ac068d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:18.601642 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bcf47289-5cbb-446b-b3af-523fc3ac068d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:18.602998 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bcf47289-5cbb-446b-b3af-523fc3ac068d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:18.603590 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bcf47289-5cbb-446b-b3af-523fc3ac068d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:18.604290 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bcf47289-5cbb-446b-b3af-523fc3ac068d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:18.604735 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bcf47289-5cbb-446b-b3af-523fc3ac068d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:18.605149 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bcf47289-5cbb-446b-b3af-523fc3ac068d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:18.980957 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-bcf47289-5cbb-446b-b3af-523fc3ac068d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:18.988574 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bcf47289-5cbb-446b-b3af-523fc3ac068d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1366 microversion: 2.1 time: 0.398590 Oct 04 03:33:18.989149 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 246/487] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:18 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:19.005920 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-973b685b-5f8f-4c4c-8485-d835582977b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:19.015348 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-973b685b-5f8f-4c4c-8485-d835582977b8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.442245 Oct 04 03:33:19.015880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 242/488] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:18 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:19.036042 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9d24537e-7fc4-4984-9565-2f0cdf1d7837 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:19.036649 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9d24537e-7fc4-4984-9565-2f0cdf1d7837 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:19.043278 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d24537e-7fc4-4984-9565-2f0cdf1d7837 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:19.043782 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d24537e-7fc4-4984-9565-2f0cdf1d7837 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:19.044205 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d24537e-7fc4-4984-9565-2f0cdf1d7837 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:19.045203 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d24537e-7fc4-4984-9565-2f0cdf1d7837 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:19.045647 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d24537e-7fc4-4984-9565-2f0cdf1d7837 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:19.046066 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d24537e-7fc4-4984-9565-2f0cdf1d7837 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:19.378238 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9d24537e-7fc4-4984-9565-2f0cdf1d7837 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:19.386989 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9d24537e-7fc4-4984-9565-2f0cdf1d7837 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1319 microversion: 2.1 time: 0.354892 Oct 04 03:33:19.387762 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 247/489] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:19 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:20.012103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f92fd961-b665-4114-977f-b6e88cb2dfd1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:20.012841 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f92fd961-b665-4114-977f-b6e88cb2dfd1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:20.019323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f92fd961-b665-4114-977f-b6e88cb2dfd1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:20.019844 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f92fd961-b665-4114-977f-b6e88cb2dfd1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:20.020708 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f92fd961-b665-4114-977f-b6e88cb2dfd1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:20.021502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f92fd961-b665-4114-977f-b6e88cb2dfd1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:20.022125 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f92fd961-b665-4114-977f-b6e88cb2dfd1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:20.022611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f92fd961-b665-4114-977f-b6e88cb2dfd1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:20.039362 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1e9cc5a3-85dd-4067-99ec-5d83202f46a3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:20.040870 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1e9cc5a3-85dd-4067-99ec-5d83202f46a3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:20.047621 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e9cc5a3-85dd-4067-99ec-5d83202f46a3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:20.048108 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e9cc5a3-85dd-4067-99ec-5d83202f46a3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:20.048540 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e9cc5a3-85dd-4067-99ec-5d83202f46a3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:20.049245 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e9cc5a3-85dd-4067-99ec-5d83202f46a3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:20.049695 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e9cc5a3-85dd-4067-99ec-5d83202f46a3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:20.050302 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e9cc5a3-85dd-4067-99ec-5d83202f46a3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:20.226510 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f92fd961-b665-4114-977f-b6e88cb2dfd1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:20.233998 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1e9cc5a3-85dd-4067-99ec-5d83202f46a3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:20.234455 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f92fd961-b665-4114-977f-b6e88cb2dfd1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1366 microversion: 2.1 time: 0.226990 Oct 04 03:33:20.235029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 243/490] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:20 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:20.242592 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1e9cc5a3-85dd-4067-99ec-5d83202f46a3 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.207060 Oct 04 03:33:20.243674 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 248/491] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:20 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:20.410456 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-309e9be7-7fcb-4f94-9c77-ed0e250dba44 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:20.410996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-309e9be7-7fcb-4f94-9c77-ed0e250dba44 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:20.417325 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-309e9be7-7fcb-4f94-9c77-ed0e250dba44 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:20.417815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-309e9be7-7fcb-4f94-9c77-ed0e250dba44 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:20.418243 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-309e9be7-7fcb-4f94-9c77-ed0e250dba44 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:20.418976 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-309e9be7-7fcb-4f94-9c77-ed0e250dba44 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:20.419481 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-309e9be7-7fcb-4f94-9c77-ed0e250dba44 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:20.419930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-309e9be7-7fcb-4f94-9c77-ed0e250dba44 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:20.637075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-309e9be7-7fcb-4f94-9c77-ed0e250dba44 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:20.647084 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-309e9be7-7fcb-4f94-9c77-ed0e250dba44 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1319 microversion: 2.1 time: 0.240524 Oct 04 03:33:20.647809 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 244/492] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:20 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:21.233997 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d4ae2653-38a5-4625-8936-1114b4a652b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:21.234502 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d4ae2653-38a5-4625-8936-1114b4a652b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:21.240911 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d4ae2653-38a5-4625-8936-1114b4a652b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:21.241392 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d4ae2653-38a5-4625-8936-1114b4a652b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:21.241827 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d4ae2653-38a5-4625-8936-1114b4a652b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:21.242525 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d4ae2653-38a5-4625-8936-1114b4a652b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:21.242969 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d4ae2653-38a5-4625-8936-1114b4a652b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:21.243384 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d4ae2653-38a5-4625-8936-1114b4a652b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:21.257240 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7a5ecfcc-16c2-4dae-bca6-2341568cb0c1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:21.257911 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-7a5ecfcc-16c2-4dae-bca6-2341568cb0c1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:21.261459 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:21.265187 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a5ecfcc-16c2-4dae-bca6-2341568cb0c1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:21.265668 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a5ecfcc-16c2-4dae-bca6-2341568cb0c1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:21.266094 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a5ecfcc-16c2-4dae-bca6-2341568cb0c1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:21.266782 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a5ecfcc-16c2-4dae-bca6-2341568cb0c1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:21.267230 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a5ecfcc-16c2-4dae-bca6-2341568cb0c1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:21.267688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7a5ecfcc-16c2-4dae-bca6-2341568cb0c1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:21.276261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d4ae2653-38a5-4625-8936-1114b4a652b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/os-volume_attachments/b9b002fe-8271-4ab7-8874-599782d72505" status: 200 len: 194 microversion: 2.20 time: 0.046370 Oct 04 03:33:21.276855 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 249/493] 10.222.0.25 () {60 vars in 1454 bytes} [Tue Oct 4 03:33:21 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/os-volume_attachments/b9b002fe-8271-4ab7-8874-599782d72505 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:33:21.281242 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4417eff9-5eb4-4448-915a-7e99366cd8a1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:21.282142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4417eff9-5eb4-4448-915a-7e99366cd8a1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:21.288274 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4417eff9-5eb4-4448-915a-7e99366cd8a1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:21.288759 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4417eff9-5eb4-4448-915a-7e99366cd8a1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:21.289191 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4417eff9-5eb4-4448-915a-7e99366cd8a1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:21.290985 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4417eff9-5eb4-4448-915a-7e99366cd8a1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:21.290985 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4417eff9-5eb4-4448-915a-7e99366cd8a1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:21.291365 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4417eff9-5eb4-4448-915a-7e99366cd8a1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:21.473299 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7a5ecfcc-16c2-4dae-bca6-2341568cb0c1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:21.478435 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-4417eff9-5eb4-4448-915a-7e99366cd8a1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:21.481553 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-7a5ecfcc-16c2-4dae-bca6-2341568cb0c1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1366 microversion: 2.1 time: 0.228104 Oct 04 03:33:21.482125 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 245/494] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:21 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:21.486721 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-5d608bb9-8478-40e9-bd80-c9f906e781f1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:21.486858 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4417eff9-5eb4-4448-915a-7e99366cd8a1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.209055 Oct 04 03:33:21.487138 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-5d608bb9-8478-40e9-bd80-c9f906e781f1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:21.487582 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 250/495] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:21 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:21.492872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5d608bb9-8478-40e9-bd80-c9f906e781f1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:21.493531 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5d608bb9-8478-40e9-bd80-c9f906e781f1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:21.493962 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5d608bb9-8478-40e9-bd80-c9f906e781f1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:21.494643 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5d608bb9-8478-40e9-bd80-c9f906e781f1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:21.495086 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5d608bb9-8478-40e9-bd80-c9f906e781f1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:21.495521 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5d608bb9-8478-40e9-bd80-c9f906e781f1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:21.616374 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-5d608bb9-8478-40e9-bd80-c9f906e781f1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lazy-loading 'services' on Instance uuid f680f852-0ad9-4478-912f-1821b7755927 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:33:21.669833 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a9441d3d-65e0-4ea9-a77a-91954808f587 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:21.670437 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a9441d3d-65e0-4ea9-a77a-91954808f587 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:21.672284 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:21.677635 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a9441d3d-65e0-4ea9-a77a-91954808f587 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:21.678111 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a9441d3d-65e0-4ea9-a77a-91954808f587 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:21.678545 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a9441d3d-65e0-4ea9-a77a-91954808f587 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:21.679230 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a9441d3d-65e0-4ea9-a77a-91954808f587 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:21.679706 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a9441d3d-65e0-4ea9-a77a-91954808f587 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:21.680891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a9441d3d-65e0-4ea9-a77a-91954808f587 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:21.734257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-5d608bb9-8478-40e9-bd80-c9f906e781f1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/os-volume_attachments/b9b002fe-8271-4ab7-8874-599782d72505" status: 202 len: 0 microversion: 2.20 time: 0.250884 Oct 04 03:33:21.735092 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 246/496] 10.222.0.25 () {60 vars in 1457 bytes} [Tue Oct 4 03:33:21 2022] DELETE /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/os-volume_attachments/b9b002fe-8271-4ab7-8874-599782d72505 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:33:21.744630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0d10339c-71a1-4cfb-b294-97d3b762cc63 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:21.747069 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-0d10339c-71a1-4cfb-b294-97d3b762cc63 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:21.753740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d10339c-71a1-4cfb-b294-97d3b762cc63 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:21.754412 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d10339c-71a1-4cfb-b294-97d3b762cc63 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:21.754865 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d10339c-71a1-4cfb-b294-97d3b762cc63 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:21.755746 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d10339c-71a1-4cfb-b294-97d3b762cc63 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:21.756270 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d10339c-71a1-4cfb-b294-97d3b762cc63 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:21.756800 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0d10339c-71a1-4cfb-b294-97d3b762cc63 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:21.796592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0d10339c-71a1-4cfb-b294-97d3b762cc63 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056966 Oct 04 03:33:21.797157 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 247/497] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Oct 4 03:33:21 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 03:33:21.828291 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a9441d3d-65e0-4ea9-a77a-91954808f587 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:21.836307 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a9441d3d-65e0-4ea9-a77a-91954808f587 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1319 microversion: 2.1 time: 0.170202 Oct 04 03:33:21.836883 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 251/498] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:21 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:22.419139 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-6f4ac250-f132-42ff-a7d7-15c3ae138801 req-30b88cf2-8a71-4828-8cb8-3e8ca09a4292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbd62e87-038e-4701-a33e-81e924d68abd", "name": "network-vif-plugged", "status": "completed", "tag": "4e655acc-1939-4263-a840-6575212375cd"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:22.431537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-6f4ac250-f132-42ff-a7d7-15c3ae138801 req-30b88cf2-8a71-4828-8cb8-3e8ca09a4292 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:22.432360 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-6f4ac250-f132-42ff-a7d7-15c3ae138801 req-30b88cf2-8a71-4828-8cb8-3e8ca09a4292 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:22.432917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-6f4ac250-f132-42ff-a7d7-15c3ae138801 req-30b88cf2-8a71-4828-8cb8-3e8ca09a4292 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:22.446654 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-6f4ac250-f132-42ff-a7d7-15c3ae138801 req-30b88cf2-8a71-4828-8cb8-3e8ca09a4292 service nova] Creating event network-vif-plugged:4e655acc-1939-4263-a840-6575212375cd for instance fbd62e87-038e-4701-a33e-81e924d68abd on hv-cinder-84914 Oct 04 03:33:22.451835 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-6f4ac250-f132-42ff-a7d7-15c3ae138801 req-30b88cf2-8a71-4828-8cb8-3e8ca09a4292 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037412 Oct 04 03:33:22.452437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 248/499] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:22.508590 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3b5f1ca2-4287-4d90-a48d-2e0b821c4464 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:22.509819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3b5f1ca2-4287-4d90-a48d-2e0b821c4464 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:22.511908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e937aff9-9e02-4bd7-8939-913146862b7e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:22.513407 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e937aff9-9e02-4bd7-8939-913146862b7e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:22.517125 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b5f1ca2-4287-4d90-a48d-2e0b821c4464 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:22.518032 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b5f1ca2-4287-4d90-a48d-2e0b821c4464 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:22.518657 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b5f1ca2-4287-4d90-a48d-2e0b821c4464 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:22.519550 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b5f1ca2-4287-4d90-a48d-2e0b821c4464 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:22.520178 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b5f1ca2-4287-4d90-a48d-2e0b821c4464 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:22.520396 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e937aff9-9e02-4bd7-8939-913146862b7e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:22.520886 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e937aff9-9e02-4bd7-8939-913146862b7e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:22.521192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b5f1ca2-4287-4d90-a48d-2e0b821c4464 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:22.521503 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e937aff9-9e02-4bd7-8939-913146862b7e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:22.522212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e937aff9-9e02-4bd7-8939-913146862b7e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:22.523853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e937aff9-9e02-4bd7-8939-913146862b7e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:22.524913 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e937aff9-9e02-4bd7-8939-913146862b7e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:22.793187 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-3b5f1ca2-4287-4d90-a48d-2e0b821c4464 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:22.803198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3b5f1ca2-4287-4d90-a48d-2e0b821c4464 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1366 microversion: 2.1 time: 0.300627 Oct 04 03:33:22.807085 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e937aff9-9e02-4bd7-8939-913146862b7e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:22.816281 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 252/500] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:22 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:22.818564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e937aff9-9e02-4bd7-8939-913146862b7e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.311723 Oct 04 03:33:22.819277 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 249/501] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:22 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:22.827416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b7fbd221-15e8-4d2d-bc0d-8b7ba5b9a895 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:22.829769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b7fbd221-15e8-4d2d-bc0d-8b7ba5b9a895 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:22.839031 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7fbd221-15e8-4d2d-bc0d-8b7ba5b9a895 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:22.839571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7fbd221-15e8-4d2d-bc0d-8b7ba5b9a895 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:22.840013 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7fbd221-15e8-4d2d-bc0d-8b7ba5b9a895 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:22.840749 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7fbd221-15e8-4d2d-bc0d-8b7ba5b9a895 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:22.841196 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7fbd221-15e8-4d2d-bc0d-8b7ba5b9a895 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:22.844544 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7fbd221-15e8-4d2d-bc0d-8b7ba5b9a895 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:22.852932 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:22.865315 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-8814245f-5380-4e88-bdcb-1218b89ce0d3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:22.866537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-8814245f-5380-4e88-bdcb-1218b89ce0d3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:22.873854 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8814245f-5380-4e88-bdcb-1218b89ce0d3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:22.874476 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8814245f-5380-4e88-bdcb-1218b89ce0d3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:22.875028 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8814245f-5380-4e88-bdcb-1218b89ce0d3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:22.875864 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8814245f-5380-4e88-bdcb-1218b89ce0d3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:22.876468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8814245f-5380-4e88-bdcb-1218b89ce0d3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:22.876969 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8814245f-5380-4e88-bdcb-1218b89ce0d3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:22.881972 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:22.887350 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b7fbd221-15e8-4d2d-bc0d-8b7ba5b9a895 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070014 Oct 04 03:33:22.887979 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 253/502] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Oct 4 03:33:22 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:22.953784 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-76c0f45c-2868-4553-b5dc-b72aec8c413f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:22.954367 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-76c0f45c-2868-4553-b5dc-b72aec8c413f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:22.960380 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-76c0f45c-2868-4553-b5dc-b72aec8c413f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:22.960862 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-76c0f45c-2868-4553-b5dc-b72aec8c413f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:22.961807 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-76c0f45c-2868-4553-b5dc-b72aec8c413f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:22.962537 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-76c0f45c-2868-4553-b5dc-b72aec8c413f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:22.962983 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-76c0f45c-2868-4553-b5dc-b72aec8c413f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:22.963402 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-76c0f45c-2868-4553-b5dc-b72aec8c413f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:22.989814 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-76c0f45c-2868-4553-b5dc-b72aec8c413f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:33:23.022504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-8814245f-5380-4e88-bdcb-1218b89ce0d3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:23.030837 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-8814245f-5380-4e88-bdcb-1218b89ce0d3 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1319 microversion: 2.1 time: 0.173583 Oct 04 03:33:23.031625 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 250/503] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:22 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:23.071197 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-76c0f45c-2868-4553-b5dc-b72aec8c413f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 204 len: 0 microversion: 2.20 time: 0.120453 Oct 04 03:33:23.073307 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 254/504] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Oct 4 03:33:22 2022] DELETE /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 03:33:23.082266 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0e8e359d-58ec-483f-8420-2bdc71c7fcf8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:23.082892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-0e8e359d-58ec-483f-8420-2bdc71c7fcf8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:23.090358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e8e359d-58ec-483f-8420-2bdc71c7fcf8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:23.091183 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e8e359d-58ec-483f-8420-2bdc71c7fcf8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:23.091736 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e8e359d-58ec-483f-8420-2bdc71c7fcf8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:23.092784 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e8e359d-58ec-483f-8420-2bdc71c7fcf8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:23.093254 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e8e359d-58ec-483f-8420-2bdc71c7fcf8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:23.093767 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e8e359d-58ec-483f-8420-2bdc71c7fcf8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:23.235610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0e8e359d-58ec-483f-8420-2bdc71c7fcf8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:23.244549 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0e8e359d-58ec-483f-8420-2bdc71c7fcf8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:23.246024 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0e8e359d-58ec-483f-8420-2bdc71c7fcf8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:23.248144 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0e8e359d-58ec-483f-8420-2bdc71c7fcf8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.169438 Oct 04 03:33:23.249115 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 251/505] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:23 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:23.828628 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=14 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:23.832871 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6471d6a0-f05d-4497-87c0-b1133789e988 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:23.833566 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6471d6a0-f05d-4497-87c0-b1133789e988 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:23.840127 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6471d6a0-f05d-4497-87c0-b1133789e988 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:23.840610 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6471d6a0-f05d-4497-87c0-b1133789e988 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:23.841041 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6471d6a0-f05d-4497-87c0-b1133789e988 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:23.841269 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:23.841732 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6471d6a0-f05d-4497-87c0-b1133789e988 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:23.842017 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=6 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:23.842178 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6471d6a0-f05d-4497-87c0-b1133789e988 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:23.842601 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6471d6a0-f05d-4497-87c0-b1133789e988 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:23.846473 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-76b97169-4708-4361-853e-e764a2de4ace tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:23.847152 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-76b97169-4708-4361-853e-e764a2de4ace tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:23.856596 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-76b97169-4708-4361-853e-e764a2de4ace tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:23.857080 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-76b97169-4708-4361-853e-e764a2de4ace tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:23.857504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-76b97169-4708-4361-853e-e764a2de4ace tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:23.858189 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-76b97169-4708-4361-853e-e764a2de4ace tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:23.858636 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-76b97169-4708-4361-853e-e764a2de4ace tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:23.859108 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-76b97169-4708-4361-853e-e764a2de4ace tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:24.044953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6471d6a0-f05d-4497-87c0-b1133789e988 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:24.052466 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-76b97169-4708-4361-853e-e764a2de4ace tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:24.053505 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6471d6a0-f05d-4497-87c0-b1133789e988 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1366 microversion: 2.1 time: 0.226368 Oct 04 03:33:24.054327 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 255/506] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:23 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:24.062006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-76b97169-4708-4361-853e-e764a2de4ace tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.221887 Oct 04 03:33:24.063973 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 252/507] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:23 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:24.073044 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c82bd995-82f8-45a4-ac52-c17b1e8fde76 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:24.073676 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c82bd995-82f8-45a4-ac52-c17b1e8fde76 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:24.080839 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c82bd995-82f8-45a4-ac52-c17b1e8fde76 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:24.081358 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c82bd995-82f8-45a4-ac52-c17b1e8fde76 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:24.081785 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c82bd995-82f8-45a4-ac52-c17b1e8fde76 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:24.082473 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c82bd995-82f8-45a4-ac52-c17b1e8fde76 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:24.082915 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c82bd995-82f8-45a4-ac52-c17b1e8fde76 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:24.083515 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c82bd995-82f8-45a4-ac52-c17b1e8fde76 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:24.224551 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c82bd995-82f8-45a4-ac52-c17b1e8fde76 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:24.232997 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c82bd995-82f8-45a4-ac52-c17b1e8fde76 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1319 microversion: 2.1 time: 0.172345 Oct 04 03:33:24.233670 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 256/508] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:24 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:24.274718 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-228eaa1f-9484-4d25-afa5-4b1fa1c65cbd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:24.275333 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-228eaa1f-9484-4d25-afa5-4b1fa1c65cbd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:24.281159 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-228eaa1f-9484-4d25-afa5-4b1fa1c65cbd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:24.281625 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-228eaa1f-9484-4d25-afa5-4b1fa1c65cbd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:24.282047 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-228eaa1f-9484-4d25-afa5-4b1fa1c65cbd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:24.282719 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-228eaa1f-9484-4d25-afa5-4b1fa1c65cbd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:24.283157 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-228eaa1f-9484-4d25-afa5-4b1fa1c65cbd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:24.283602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-228eaa1f-9484-4d25-afa5-4b1fa1c65cbd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:24.415009 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-228eaa1f-9484-4d25-afa5-4b1fa1c65cbd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:24.422901 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-228eaa1f-9484-4d25-afa5-4b1fa1c65cbd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:24.424345 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-228eaa1f-9484-4d25-afa5-4b1fa1c65cbd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:24.425481 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-228eaa1f-9484-4d25-afa5-4b1fa1c65cbd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.155269 Oct 04 03:33:24.426030 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 253/509] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:24 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:33:24.479658 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-664fb7d0-e370-4502-95c4-0f4946430024 req-a638a9e3-efc8-4de3-9694-c450bbf9aeb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa285589-057b-4a56-9da5-614e561bb64b", "name": "network-vif-plugged", "status": "completed", "tag": "2894bf1c-f43d-482f-921b-831aac745902"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:24.488771 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-664fb7d0-e370-4502-95c4-0f4946430024 req-a638a9e3-efc8-4de3-9694-c450bbf9aeb4 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:24.489241 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-664fb7d0-e370-4502-95c4-0f4946430024 req-a638a9e3-efc8-4de3-9694-c450bbf9aeb4 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:24.489661 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-664fb7d0-e370-4502-95c4-0f4946430024 req-a638a9e3-efc8-4de3-9694-c450bbf9aeb4 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:24.500251 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-664fb7d0-e370-4502-95c4-0f4946430024 req-a638a9e3-efc8-4de3-9694-c450bbf9aeb4 service nova] Creating event network-vif-plugged:2894bf1c-f43d-482f-921b-831aac745902 for instance fa285589-057b-4a56-9da5-614e561bb64b on hv-cinder-84914 Oct 04 03:33:24.504920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-664fb7d0-e370-4502-95c4-0f4946430024 req-a638a9e3-efc8-4de3-9694-c450bbf9aeb4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029546 Oct 04 03:33:24.505464 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 257/510] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:25.076913 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-72f186c0-1827-4930-8822-f658ce4d5ccc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:25.077622 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-72f186c0-1827-4930-8822-f658ce4d5ccc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:25.085797 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-72f186c0-1827-4930-8822-f658ce4d5ccc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:25.086820 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-72f186c0-1827-4930-8822-f658ce4d5ccc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:25.087667 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-72f186c0-1827-4930-8822-f658ce4d5ccc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:25.087961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-72f186c0-1827-4930-8822-f658ce4d5ccc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:25.088395 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-72f186c0-1827-4930-8822-f658ce4d5ccc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:25.088819 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-72f186c0-1827-4930-8822-f658ce4d5ccc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:25.097524 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ebb1baac-afbc-4660-8769-5117fe4e4cd5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:25.098229 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ebb1baac-afbc-4660-8769-5117fe4e4cd5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:25.110135 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ebb1baac-afbc-4660-8769-5117fe4e4cd5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:25.110658 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ebb1baac-afbc-4660-8769-5117fe4e4cd5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:25.111616 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ebb1baac-afbc-4660-8769-5117fe4e4cd5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:25.111815 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ebb1baac-afbc-4660-8769-5117fe4e4cd5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:25.112296 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ebb1baac-afbc-4660-8769-5117fe4e4cd5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:25.115681 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ebb1baac-afbc-4660-8769-5117fe4e4cd5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:25.641158 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-72f186c0-1827-4930-8822-f658ce4d5ccc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:25.666611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-72f186c0-1827-4930-8822-f658ce4d5ccc tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1366 microversion: 2.1 time: 0.593399 Oct 04 03:33:25.667204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 254/511] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:25 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1366 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:25.671783 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0cdeed9b-3c16-490b-8bdd-44155285188c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:25.672409 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-0cdeed9b-3c16-490b-8bdd-44155285188c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:25.678183 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0cdeed9b-3c16-490b-8bdd-44155285188c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:25.678662 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0cdeed9b-3c16-490b-8bdd-44155285188c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:25.679095 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0cdeed9b-3c16-490b-8bdd-44155285188c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:25.679810 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0cdeed9b-3c16-490b-8bdd-44155285188c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:25.681034 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0cdeed9b-3c16-490b-8bdd-44155285188c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:25.681462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0cdeed9b-3c16-490b-8bdd-44155285188c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:25.722713 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ebb1baac-afbc-4660-8769-5117fe4e4cd5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:25.731179 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ebb1baac-afbc-4660-8769-5117fe4e4cd5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.647605 Oct 04 03:33:25.731779 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 258/512] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:25 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:25.737526 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b894eb51-4143-4f66-a509-606d02a3ed2f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:25.738131 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b894eb51-4143-4f66-a509-606d02a3ed2f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:25.744584 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b894eb51-4143-4f66-a509-606d02a3ed2f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:25.745065 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b894eb51-4143-4f66-a509-606d02a3ed2f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:25.745493 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b894eb51-4143-4f66-a509-606d02a3ed2f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:25.746386 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b894eb51-4143-4f66-a509-606d02a3ed2f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:25.746833 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b894eb51-4143-4f66-a509-606d02a3ed2f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:25.747409 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b894eb51-4143-4f66-a509-606d02a3ed2f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:25.988917 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0cdeed9b-3c16-490b-8bdd-44155285188c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:25.997131 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0cdeed9b-3c16-490b-8bdd-44155285188c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1507 microversion: 2.1 time: 0.328847 Oct 04 03:33:25.997709 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 255/513] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:25 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:26.020148 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-48c289c8-6306-40b3-a648-b46f3e955553 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "059ce37a-ae85-497b-8f2b-15254704cd13", "device": "/dev/sdb"}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:26.022572 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-48c289c8-6306-40b3-a648-b46f3e955553 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:26.029358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48c289c8-6306-40b3-a648-b46f3e955553 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:26.029836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48c289c8-6306-40b3-a648-b46f3e955553 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:26.030293 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48c289c8-6306-40b3-a648-b46f3e955553 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:26.030979 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48c289c8-6306-40b3-a648-b46f3e955553 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:26.031425 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48c289c8-6306-40b3-a648-b46f3e955553 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:26.031870 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48c289c8-6306-40b3-a648-b46f3e955553 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:26.041922 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b894eb51-4143-4f66-a509-606d02a3ed2f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:26.050379 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b894eb51-4143-4f66-a509-606d02a3ed2f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:26.051964 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b894eb51-4143-4f66-a509-606d02a3ed2f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:26.053399 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b894eb51-4143-4f66-a509-606d02a3ed2f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1720 microversion: 2.20 time: 0.320419 Oct 04 03:33:26.054029 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 259/514] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:25 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1720 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:26.563438 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-6d28cfb6-c57f-4fd6-8367-fdf6ae7ded82 req-4e4dd411-0073-451a-a962-0979afa0f0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f680f852-0ad9-4478-912f-1821b7755927", "name": "network-vif-deleted", "tag": "b303180f-7432-4f63-b46d-6cc9c707c0d6"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:26.574128 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-6d28cfb6-c57f-4fd6-8367-fdf6ae7ded82 req-4e4dd411-0073-451a-a962-0979afa0f0a7 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:26.574685 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-6d28cfb6-c57f-4fd6-8367-fdf6ae7ded82 req-4e4dd411-0073-451a-a962-0979afa0f0a7 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:26.575185 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-6d28cfb6-c57f-4fd6-8367-fdf6ae7ded82 req-4e4dd411-0073-451a-a962-0979afa0f0a7 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:26.586661 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-6d28cfb6-c57f-4fd6-8367-fdf6ae7ded82 req-4e4dd411-0073-451a-a962-0979afa0f0a7 service nova] Creating event network-vif-deleted:b303180f-7432-4f63-b46d-6cc9c707c0d6 for instance f680f852-0ad9-4478-912f-1821b7755927 on hv-cinder-84914 Oct 04 03:33:26.591520 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-6d28cfb6-c57f-4fd6-8367-fdf6ae7ded82 req-4e4dd411-0073-451a-a962-0979afa0f0a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031725 Oct 04 03:33:26.592187 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 260/515] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:33:26.690876 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2399f4a9-02be-49b8-91e1-f354396fac75 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:26.691720 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2399f4a9-02be-49b8-91e1-f354396fac75 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:26.699273 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2399f4a9-02be-49b8-91e1-f354396fac75 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:26.699883 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2399f4a9-02be-49b8-91e1-f354396fac75 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:26.700390 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2399f4a9-02be-49b8-91e1-f354396fac75 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:26.701172 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2399f4a9-02be-49b8-91e1-f354396fac75 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:26.701691 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2399f4a9-02be-49b8-91e1-f354396fac75 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:26.702303 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2399f4a9-02be-49b8-91e1-f354396fac75 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:26.871172 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2399f4a9-02be-49b8-91e1-f354396fac75 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:26.879667 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2399f4a9-02be-49b8-91e1-f354396fac75 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1366 microversion: 2.1 time: 0.192570 Oct 04 03:33:26.880510 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 261/516] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:26 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:26.886162 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-434627db-5065-4251-a8cb-a7063f60bfd2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:26.886756 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-434627db-5065-4251-a8cb-a7063f60bfd2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:26.893607 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-434627db-5065-4251-a8cb-a7063f60bfd2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:26.894355 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-434627db-5065-4251-a8cb-a7063f60bfd2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:26.894994 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-434627db-5065-4251-a8cb-a7063f60bfd2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:26.896062 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-434627db-5065-4251-a8cb-a7063f60bfd2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:26.896510 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-434627db-5065-4251-a8cb-a7063f60bfd2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:26.896926 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-434627db-5065-4251-a8cb-a7063f60bfd2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:27.009076 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-48c289c8-6306-40b3-a648-b46f3e955553 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "POST /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.992487 Oct 04 03:33:27.009932 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 256/517] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Oct 4 03:33:26 2022] POST /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd/os-volume_attachments => generated 194 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:33:27.080994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:27.082174 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:27.088595 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:27.089160 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:27.089667 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:27.090458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:27.090979 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:27.091604 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:27.106327 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-434627db-5065-4251-a8cb-a7063f60bfd2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:27.114489 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-434627db-5065-4251-a8cb-a7063f60bfd2 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.232726 Oct 04 03:33:27.115055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 262/518] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:26 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:27.126513 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:27.127216 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:27.127832 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:27.128459 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lazy-loading 'fault' on Instance uuid f680f852-0ad9-4478-912f-1821b7755927 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:33:27.170401 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:27.178502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:27.180710 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:27.181883 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e66cee8d-a8f6-4c45-a8b5-c8b6a6b40e8e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 200 len: 1370 microversion: 2.20 time: 0.105064 Oct 04 03:33:27.182446 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 257/519] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:27 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 1370 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:27.905893 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-255ed148-5bd3-4d4d-affa-ade838dc5a7b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:27.906442 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-255ed148-5bd3-4d4d-affa-ade838dc5a7b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:27.912668 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-255ed148-5bd3-4d4d-affa-ade838dc5a7b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:27.913140 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-255ed148-5bd3-4d4d-affa-ade838dc5a7b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:27.913563 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-255ed148-5bd3-4d4d-affa-ade838dc5a7b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:27.914972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-255ed148-5bd3-4d4d-affa-ade838dc5a7b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:27.915604 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-255ed148-5bd3-4d4d-affa-ade838dc5a7b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:27.916028 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-255ed148-5bd3-4d4d-affa-ade838dc5a7b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:28.047527 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-255ed148-5bd3-4d4d-affa-ade838dc5a7b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:28.055834 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-255ed148-5bd3-4d4d-affa-ade838dc5a7b tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1556 microversion: 2.1 time: 0.153275 Oct 04 03:33:28.056545 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 263/520] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:27 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:28.079128 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-69248e35-657c-4cce-8b6c-49542a08c392 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:28.079688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-69248e35-657c-4cce-8b6c-49542a08c392 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:28.086596 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-69248e35-657c-4cce-8b6c-49542a08c392 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:28.087101 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-69248e35-657c-4cce-8b6c-49542a08c392 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:28.087552 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-69248e35-657c-4cce-8b6c-49542a08c392 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:28.088250 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-69248e35-657c-4cce-8b6c-49542a08c392 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:28.088711 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-69248e35-657c-4cce-8b6c-49542a08c392 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:28.089134 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-69248e35-657c-4cce-8b6c-49542a08c392 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:28.138955 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e50d704a-2aa0-4bad-bc5f-4c476c02fb37 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:28.139583 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e50d704a-2aa0-4bad-bc5f-4c476c02fb37 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:28.146418 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e50d704a-2aa0-4bad-bc5f-4c476c02fb37 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:28.147543 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e50d704a-2aa0-4bad-bc5f-4c476c02fb37 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:28.147983 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e50d704a-2aa0-4bad-bc5f-4c476c02fb37 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:28.148680 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e50d704a-2aa0-4bad-bc5f-4c476c02fb37 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:28.149432 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e50d704a-2aa0-4bad-bc5f-4c476c02fb37 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:28.149952 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e50d704a-2aa0-4bad-bc5f-4c476c02fb37 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:28.165946 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-69248e35-657c-4cce-8b6c-49542a08c392 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090562 Oct 04 03:33:28.166624 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 258/521] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Oct 4 03:33:28 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:28.207561 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-60483653-056f-41e8-b5e9-ec707717a485 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:28.208163 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-60483653-056f-41e8-b5e9-ec707717a485 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:28.214725 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-60483653-056f-41e8-b5e9-ec707717a485 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:28.215208 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-60483653-056f-41e8-b5e9-ec707717a485 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:28.215676 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-60483653-056f-41e8-b5e9-ec707717a485 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:28.216376 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-60483653-056f-41e8-b5e9-ec707717a485 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:28.216820 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-60483653-056f-41e8-b5e9-ec707717a485 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:28.217240 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-60483653-056f-41e8-b5e9-ec707717a485 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:28.230873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-60483653-056f-41e8-b5e9-ec707717a485 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] HTTP exception thrown: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-60483653-056f-41e8-b5e9-ec707717a485 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Request method failure captured: Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 HTTP/1.1 Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6ih4h6XX68iKzuuSj1ucm6Lfc1S4xbbk_ttwNyYtNAwImXdILd340Px5C-UXJjLIofleuW5nKBdQRIqpo21J6-J7gAtwXrJJdYWeFuoECfIFXsRxy0j2IMN6r4zpnHWD1sWuHIgQZ9iD4CadAZCe4FH-sRHO-ZeZC0niBSKO4TjlYg Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 96643b79b7724c398b1df29f9ea0bbd4 Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:33:28.232546 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:33:28.234284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96643b79b7724c398b1df29f9ea0bbd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96643b79b7724c398b1df29f9ea0bbd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_96643b79b7724c398b1df29f9ea0bbd4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/96643b79b7724c398b1df29f9ea0bbd4"}]}] Oct 04 03:33:28.234284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:33:28.234284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 96643b79b7724c398b1df29f9ea0bbd4 Oct 04 03:33:28.234284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:33:28.234284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-AttachVolumeShelveTestJSON-131436698-project Oct 04 03:33:28.234284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:33:28.234284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:33:28.234284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 542b137fb8cd4d25867d95a13d2cb651 Oct 04 03:33:28.234284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-131436698-project Oct 04 03:33:28.234284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:33:28.234284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:33:28.234284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': 'f680f852-0ad9-4478-912f-1821b7755927'} Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:33:28.235323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:33:28.236688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:33:28.238194 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-60483653-056f-41e8-b5e9-ec707717a485 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Returning 404 to user: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:33:28.238194 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-60483653-056f-41e8-b5e9-ec707717a485 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 404 len: 111 microversion: 2.20 time: 0.030245 Oct 04 03:33:28.238194 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 259/522] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:28 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 03:33:28.243291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e55949d6-28e1-4163-a84a-22fdea3d7148 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '.version_select at 0x7f165b54df70>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:28.264374 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e55949d6-28e1-4163-a84a-22fdea3d7148 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-291350842" status: 204 len: 0 microversion: 2.20 time: 0.025311 Oct 04 03:33:28.264949 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 260/523] 10.222.0.25 () {60 vars in 1259 bytes} [Tue Oct 4 03:33:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-291350842 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 03:33:28.405124 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e50d704a-2aa0-4bad-bc5f-4c476c02fb37 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:28.413776 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e50d704a-2aa0-4bad-bc5f-4c476c02fb37 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1737 microversion: 2.1 time: 0.278539 Oct 04 03:33:28.415661 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 264/524] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:28 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1737 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:28.931173 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-3a881184-eb31-4a8f-8214-c34cacfdf6b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Action: 'create', calling method: .version_select at 0x7f165b419940>, body: {"keypair": {"name": "tempest-keypair-2129873305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnXqDAr7mph2SJ8wfqu0Y9J4Tlp8KfZfqwPDhJlLnGlQSYJ4W+gnMQevQBc4NzDvqiPUwGM+Ui4w3B/DEsLcxjxqBAWeHtjv/YFyl/zdcnlhZgdOawn/z4T3D2dhSzihQ=="}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:28.952362 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-3a881184-eb31-4a8f-8214-c34cacfdf6b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Getting quotas for project 96643b79b7724c398b1df29f9ea0bbd4. Resources: {'key_pairs'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:33:28.956294 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-3a881184-eb31-4a8f-8214-c34cacfdf6b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Getting quotas for user 542b137fb8cd4d25867d95a13d2cb651 and project 96643b79b7724c398b1df29f9ea0bbd4. Resources: {'key_pairs'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:33:28.977849 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-3a881184-eb31-4a8f-8214-c34cacfdf6b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052207 Oct 04 03:33:28.978452 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 261/525] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Oct 4 03:33:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 03:33:29.278905 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-ab177c34-b7a0-44f2-92aa-e331ca2d262b req-9095cf90-a169-4e30-bb46-859164fc1978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa285589-057b-4a56-9da5-614e561bb64b", "tag": "2894bf1c-f43d-482f-921b-831aac745902"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:29.291683 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ab177c34-b7a0-44f2-92aa-e331ca2d262b req-9095cf90-a169-4e30-bb46-859164fc1978 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:29.292507 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ab177c34-b7a0-44f2-92aa-e331ca2d262b req-9095cf90-a169-4e30-bb46-859164fc1978 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:29.293165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ab177c34-b7a0-44f2-92aa-e331ca2d262b req-9095cf90-a169-4e30-bb46-859164fc1978 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:29.310455 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-ab177c34-b7a0-44f2-92aa-e331ca2d262b req-9095cf90-a169-4e30-bb46-859164fc1978 service nova] Creating event network-changed:2894bf1c-f43d-482f-921b-831aac745902 for instance fa285589-057b-4a56-9da5-614e561bb64b on hv-cinder-84914 Oct 04 03:33:29.320376 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-ab177c34-b7a0-44f2-92aa-e331ca2d262b req-9095cf90-a169-4e30-bb46-859164fc1978 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045622 Oct 04 03:33:29.321356 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 265/526] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:29.439759 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2fde35e4-c997-4f13-ab3a-2013edb5a84b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:29.441156 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-2fde35e4-c997-4f13-ab3a-2013edb5a84b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:29.448610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2fde35e4-c997-4f13-ab3a-2013edb5a84b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:29.449446 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2fde35e4-c997-4f13-ab3a-2013edb5a84b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:29.450204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2fde35e4-c997-4f13-ab3a-2013edb5a84b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:29.451019 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2fde35e4-c997-4f13-ab3a-2013edb5a84b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:29.451771 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2fde35e4-c997-4f13-ab3a-2013edb5a84b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:29.452301 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2fde35e4-c997-4f13-ab3a-2013edb5a84b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:29.608685 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-2fde35e4-c997-4f13-ab3a-2013edb5a84b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:29.621366 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2fde35e4-c997-4f13-ab3a-2013edb5a84b tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1717 microversion: 2.1 time: 0.186248 Oct 04 03:33:29.627570 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 262/527] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:29 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1717 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:29.756983 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b9ab042f-aff0-49e9-bc3a-214c3e81bd4f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:29.757676 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b9ab042f-aff0-49e9-bc3a-214c3e81bd4f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:29.764064 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b9ab042f-aff0-49e9-bc3a-214c3e81bd4f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:29.764539 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b9ab042f-aff0-49e9-bc3a-214c3e81bd4f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:29.765221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b9ab042f-aff0-49e9-bc3a-214c3e81bd4f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:29.765857 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b9ab042f-aff0-49e9-bc3a-214c3e81bd4f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:29.766302 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b9ab042f-aff0-49e9-bc3a-214c3e81bd4f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:29.766999 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b9ab042f-aff0-49e9-bc3a-214c3e81bd4f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:29.785073 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:29.877701 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-b9ab042f-aff0-49e9-bc3a-214c3e81bd4f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] HTTP exception thrown: Cannot 'detach_volume' instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 while it is in vm_state rescued Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b9ab042f-aff0-49e9-bc3a-214c3e81bd4f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Request method failure captured: Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: DELETE /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-volume_attachments/34bd1673-8f25-4cf5-b752-6afd1f280af5 HTTP/1.1 Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6iuldyrIBbW0f73v2K7ATYrextCGz2-_Yc58_h0cv-5TQFrImJgI3vgI3ryyGo9OGTifdm0w3ZapIKJj0Fj0su00BfHCMYaElTS2T4ES-IzJv9KifpjH3rp-cobaqB4aXjivbFQVaV2D5PTfUOLh5YQ34ZK3qeegc9sqNgzArwYGQ4 Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: b62fd4925f3840edb9806630cd78c9fa Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:33:29.879297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:33:29.881002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b62fd4925f3840edb9806630cd78c9fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b62fd4925f3840edb9806630cd78c9fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b62fd4925f3840edb9806630cd78c9fa", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b62fd4925f3840edb9806630cd78c9fa"}]}] Oct 04 03:33:29.881002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:33:29.881002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: b62fd4925f3840edb9806630cd78c9fa Oct 04 03:33:29.881002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:33:29.881002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-ServerRescueNegativeTestJSON-465130473-project Oct 04 03:33:29.881002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:33:29.881002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:33:29.881002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: a267cf7109c64f538824c162fedd084b Oct 04 03:33:29.881002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-465130473-project Oct 04 03:33:29.881002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:33:29.881002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Cannot 'detach_volume' instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 while it is in vm_state rescued Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'server_id': '36a2b849-4aeb-4b38-8204-9a1b6c3983d8', 'id': '34bd1673-8f25-4cf5-b752-6afd1f280af5'} Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:33:29.881835 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 while it is in vm_state rescued Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 while it is in vm_state rescued Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:33:29.883904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b9ab042f-aff0-49e9-bc3a-214c3e81bd4f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Returning 409 to user: Cannot 'detach_volume' instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 while it is in vm_state rescued {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:33:29.885195 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b9ab042f-aff0-49e9-bc3a-214c3e81bd4f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "DELETE /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-volume_attachments/34bd1673-8f25-4cf5-b752-6afd1f280af5" status: 409 len: 152 microversion: 2.1 time: 0.128105 Oct 04 03:33:29.885499 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 266/528] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Oct 4 03:33:29 2022] DELETE /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-volume_attachments/34bd1673-8f25-4cf5-b752-6afd1f280af5 => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 03:33:29.890563 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-83da626f-c9a3-4be4-b93d-b31f81c7f2ce tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:29.891381 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-83da626f-c9a3-4be4-b93d-b31f81c7f2ce tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:29.898327 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-83da626f-c9a3-4be4-b93d-b31f81c7f2ce tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:29.899102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-83da626f-c9a3-4be4-b93d-b31f81c7f2ce tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:29.899577 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-83da626f-c9a3-4be4-b93d-b31f81c7f2ce tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:29.900301 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-83da626f-c9a3-4be4-b93d-b31f81c7f2ce tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:29.900765 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-83da626f-c9a3-4be4-b93d-b31f81c7f2ce tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:29.901180 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-83da626f-c9a3-4be4-b93d-b31f81c7f2ce tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:30.002165 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-83da626f-c9a3-4be4-b93d-b31f81c7f2ce tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "POST /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/action" status: 202 len: 0 microversion: 2.1 time: 0.112984 Oct 04 03:33:30.003849 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 263/529] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Oct 4 03:33:29 2022] POST /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:33:30.017178 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f7270fcc-6619-43a0-8087-803ce62e8003 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:30.018100 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f7270fcc-6619-43a0-8087-803ce62e8003 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:30.028614 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7270fcc-6619-43a0-8087-803ce62e8003 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:30.029573 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7270fcc-6619-43a0-8087-803ce62e8003 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:30.032255 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7270fcc-6619-43a0-8087-803ce62e8003 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:30.033263 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7270fcc-6619-43a0-8087-803ce62e8003 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:30.033780 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7270fcc-6619-43a0-8087-803ce62e8003 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:30.044846 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7270fcc-6619-43a0-8087-803ce62e8003 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:30.658096 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f7270fcc-6619-43a0-8087-803ce62e8003 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:30.669926 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f7270fcc-6619-43a0-8087-803ce62e8003 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1725 microversion: 2.1 time: 0.660063 Oct 04 03:33:30.670210 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-843113706", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff24145b-812c-4e90-8679-e40583d5898d"}], "security_groups": [{"name": "tempest-securitygroup--791040213"}], "key_name": "tempest-keypair-2129873305", "user_data": "}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:30.674460 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 267/530] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:30 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1725 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:30.759655 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-00cabd55-53e9-49e8-acf9-3e1694276a48 req-7e17c32a-b9d3-4dae-858e-6eabfc70af9e admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "059ce37a-ae85-497b-8f2b-15254704cd13", "create_info": {"type": "qcow2", "new_file": "volume-059ce37a-ae85-497b-8f2b-15254704cd13.d1418044-92c2-4831-a4e2-4fb1f0a9a812.vhdx", "snapshot_id": "d1418044-92c2-4831-a4e2-4fb1f0a9a812"}}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:30.763869 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-00cabd55-53e9-49e8-acf9-3e1694276a48 req-7e17c32a-b9d3-4dae-858e-6eabfc70af9e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:30.764414 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-00cabd55-53e9-49e8-acf9-3e1694276a48 req-7e17c32a-b9d3-4dae-858e-6eabfc70af9e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:30.764869 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-00cabd55-53e9-49e8-acf9-3e1694276a48 req-7e17c32a-b9d3-4dae-858e-6eabfc70af9e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:30.776059 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-00cabd55-53e9-49e8-acf9-3e1694276a48 req-7e17c32a-b9d3-4dae-858e-6eabfc70af9e admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:30.776618 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-00cabd55-53e9-49e8-acf9-3e1694276a48 req-7e17c32a-b9d3-4dae-858e-6eabfc70af9e admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:30.778448 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-00cabd55-53e9-49e8-acf9-3e1694276a48 req-7e17c32a-b9d3-4dae-858e-6eabfc70af9e admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:30.794239 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-00cabd55-53e9-49e8-acf9-3e1694276a48 req-7e17c32a-b9d3-4dae-858e-6eabfc70af9e admin admin] 10.222.0.33 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.100000 Oct 04 03:33:30.795149 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 268/531] 10.222.0.33 () {64 vars in 1326 bytes} [Tue Oct 4 03:33:30 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 03:33:30.905041 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.network.neutron [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] validate_networks() for [('ff24145b-812c-4e90-8679-e40583d5898d', None, None, None, None, None)] {{(pid=120595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:33:31.286477 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Flavor limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:33:31.286911 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Image limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:33:31.287371 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Flavor pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:33:31.287812 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Image pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:33:31.288222 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:33:31.297698 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:31.298173 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:31.298601 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:31.299318 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:31.299797 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:31.300212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:31.317374 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Getting quotas for project 96643b79b7724c398b1df29f9ea0bbd4. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:33:31.321803 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Getting quotas for user 542b137fb8cd4d25867d95a13d2cb651 and project 96643b79b7724c398b1df29f9ea0bbd4. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:33:31.335702 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Going to run 1 instances... {{(pid=120595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:33:31.338368 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:33:31.385138 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-792f2c8f-b091-4d0b-8bc6-7fc816797739 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.722572 Oct 04 03:33:31.385781 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 264/532] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Oct 4 03:33:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 03:33:31.398321 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5bae1741-7343-4be5-9e1f-2accb2ff8bf3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:31.399266 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5bae1741-7343-4be5-9e1f-2accb2ff8bf3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:31.456269 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5bae1741-7343-4be5-9e1f-2accb2ff8bf3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:31.465092 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5bae1741-7343-4be5-9e1f-2accb2ff8bf3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:31.466948 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5bae1741-7343-4be5-9e1f-2accb2ff8bf3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:31.468090 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5bae1741-7343-4be5-9e1f-2accb2ff8bf3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1281 microversion: 2.20 time: 0.074699 Oct 04 03:33:31.468642 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 269/533] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:31 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:31.702021 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-dbc11cdb-6876-4990-b692-18bc4ef5e07f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:31.702637 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-dbc11cdb-6876-4990-b692-18bc4ef5e07f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:31.709432 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dbc11cdb-6876-4990-b692-18bc4ef5e07f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:31.710044 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dbc11cdb-6876-4990-b692-18bc4ef5e07f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:31.710484 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dbc11cdb-6876-4990-b692-18bc4ef5e07f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:31.711825 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dbc11cdb-6876-4990-b692-18bc4ef5e07f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:31.712516 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dbc11cdb-6876-4990-b692-18bc4ef5e07f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:31.712941 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dbc11cdb-6876-4990-b692-18bc4ef5e07f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:31.940486 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-dbc11cdb-6876-4990-b692-18bc4ef5e07f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:31.950005 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-dbc11cdb-6876-4990-b692-18bc4ef5e07f tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1725 microversion: 2.1 time: 0.252064 Oct 04 03:33:31.950661 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 265/534] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:31 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:32.494247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6ea7497d-e287-4089-849a-7b775373c46e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:32.494846 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6ea7497d-e287-4089-849a-7b775373c46e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:32.502428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ea7497d-e287-4089-849a-7b775373c46e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:32.502911 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ea7497d-e287-4089-849a-7b775373c46e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:32.503337 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ea7497d-e287-4089-849a-7b775373c46e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:32.504061 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ea7497d-e287-4089-849a-7b775373c46e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:32.504505 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ea7497d-e287-4089-849a-7b775373c46e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:32.504922 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6ea7497d-e287-4089-849a-7b775373c46e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:32.584148 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6ea7497d-e287-4089-849a-7b775373c46e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:32.595069 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6ea7497d-e287-4089-849a-7b775373c46e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:32.598207 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6ea7497d-e287-4089-849a-7b775373c46e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:32.599318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6ea7497d-e287-4089-849a-7b775373c46e tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1277 microversion: 2.20 time: 0.109070 Oct 04 03:33:32.619877 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 270/535] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:32 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:32.974140 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-4143f539-1a99-443a-ae85-313976fd3209 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:32.974748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-4143f539-1a99-443a-ae85-313976fd3209 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:32.982584 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4143f539-1a99-443a-ae85-313976fd3209 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:32.983070 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4143f539-1a99-443a-ae85-313976fd3209 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:32.983522 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4143f539-1a99-443a-ae85-313976fd3209 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:32.984224 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4143f539-1a99-443a-ae85-313976fd3209 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:32.984676 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4143f539-1a99-443a-ae85-313976fd3209 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:32.985098 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4143f539-1a99-443a-ae85-313976fd3209 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:33.116360 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4143f539-1a99-443a-ae85-313976fd3209 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:33.125079 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-4143f539-1a99-443a-ae85-313976fd3209 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1725 microversion: 2.1 time: 0.154780 Oct 04 03:33:33.125646 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 266/536] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:32 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:33.626102 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9d535d6e-e59f-4d58-8f51-7ef6bb9bcaad tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:33.626773 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9d535d6e-e59f-4d58-8f51-7ef6bb9bcaad tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:33.633962 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d535d6e-e59f-4d58-8f51-7ef6bb9bcaad tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:33.634448 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d535d6e-e59f-4d58-8f51-7ef6bb9bcaad tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:33.635092 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d535d6e-e59f-4d58-8f51-7ef6bb9bcaad tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:33.635825 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d535d6e-e59f-4d58-8f51-7ef6bb9bcaad tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:33.636279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d535d6e-e59f-4d58-8f51-7ef6bb9bcaad tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:33.636701 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d535d6e-e59f-4d58-8f51-7ef6bb9bcaad tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:33.702404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9d535d6e-e59f-4d58-8f51-7ef6bb9bcaad tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:33.710939 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9d535d6e-e59f-4d58-8f51-7ef6bb9bcaad tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:33.713077 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9d535d6e-e59f-4d58-8f51-7ef6bb9bcaad tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:33.714163 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9d535d6e-e59f-4d58-8f51-7ef6bb9bcaad tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1333 microversion: 2.20 time: 0.092032 Oct 04 03:33:33.714711 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 271/537] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:33 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:33.982139 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-29776973-75c7-44a7-a9f7-a99a81e852af req-daa0a3ab-9f99-4cd2-a649-9ef9c777f65d admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "059ce37a-ae85-497b-8f2b-15254704cd13", "create_info": {"type": "qcow2", "new_file": "volume-059ce37a-ae85-497b-8f2b-15254704cd13.f4bd4833-7bd9-4af0-8ebb-8c9a55654ab9.vhdx", "snapshot_id": "f4bd4833-7bd9-4af0-8ebb-8c9a55654ab9"}}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:33.985413 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-29776973-75c7-44a7-a9f7-a99a81e852af req-daa0a3ab-9f99-4cd2-a649-9ef9c777f65d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:33.985882 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-29776973-75c7-44a7-a9f7-a99a81e852af req-daa0a3ab-9f99-4cd2-a649-9ef9c777f65d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:33.986301 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-29776973-75c7-44a7-a9f7-a99a81e852af req-daa0a3ab-9f99-4cd2-a649-9ef9c777f65d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:33.994420 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-29776973-75c7-44a7-a9f7-a99a81e852af req-daa0a3ab-9f99-4cd2-a649-9ef9c777f65d admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:33.994875 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-29776973-75c7-44a7-a9f7-a99a81e852af req-daa0a3ab-9f99-4cd2-a649-9ef9c777f65d admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:33.995297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-29776973-75c7-44a7-a9f7-a99a81e852af req-daa0a3ab-9f99-4cd2-a649-9ef9c777f65d admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:34.010365 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-29776973-75c7-44a7-a9f7-a99a81e852af req-daa0a3ab-9f99-4cd2-a649-9ef9c777f65d admin admin] 10.222.0.33 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.077380 Oct 04 03:33:34.010945 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 267/538] 10.222.0.33 () {64 vars in 1326 bytes} [Tue Oct 4 03:33:33 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 03:33:34.148014 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-581512df-92ea-42ac-89e9-971870307356 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:34.149153 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-581512df-92ea-42ac-89e9-971870307356 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:34.155507 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-581512df-92ea-42ac-89e9-971870307356 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:34.155994 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-581512df-92ea-42ac-89e9-971870307356 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:34.156420 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-581512df-92ea-42ac-89e9-971870307356 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:34.157128 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-581512df-92ea-42ac-89e9-971870307356 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:34.157572 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-581512df-92ea-42ac-89e9-971870307356 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:34.157991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-581512df-92ea-42ac-89e9-971870307356 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:34.285319 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-581512df-92ea-42ac-89e9-971870307356 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:34.293525 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-581512df-92ea-42ac-89e9-971870307356 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1725 microversion: 2.1 time: 0.149372 Oct 04 03:33:34.294087 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 272/539] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:34 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:34.740723 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-3b1d0dea-8e99-4035-9db9-51984305bf01 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:34.741447 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-3b1d0dea-8e99-4035-9db9-51984305bf01 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:34.748123 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3b1d0dea-8e99-4035-9db9-51984305bf01 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:34.748596 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3b1d0dea-8e99-4035-9db9-51984305bf01 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:34.749024 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3b1d0dea-8e99-4035-9db9-51984305bf01 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:34.749696 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3b1d0dea-8e99-4035-9db9-51984305bf01 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:34.750139 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3b1d0dea-8e99-4035-9db9-51984305bf01 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:34.750552 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3b1d0dea-8e99-4035-9db9-51984305bf01 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:34.765600 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:34.822712 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-3b1d0dea-8e99-4035-9db9-51984305bf01 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:34.830663 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-3b1d0dea-8e99-4035-9db9-51984305bf01 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:34.832114 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-3b1d0dea-8e99-4035-9db9-51984305bf01 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:34.833195 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-3b1d0dea-8e99-4035-9db9-51984305bf01 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1341 microversion: 2.20 time: 0.096864 Oct 04 03:33:34.833741 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 268/540] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:34 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1341 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:35.317326 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-010ccbcd-a7f4-46a2-88e0-570500e486d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:35.318145 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-010ccbcd-a7f4-46a2-88e0-570500e486d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:35.326242 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-010ccbcd-a7f4-46a2-88e0-570500e486d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:35.326720 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-010ccbcd-a7f4-46a2-88e0-570500e486d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:35.327145 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-010ccbcd-a7f4-46a2-88e0-570500e486d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:35.327857 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-010ccbcd-a7f4-46a2-88e0-570500e486d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:35.329026 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-010ccbcd-a7f4-46a2-88e0-570500e486d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:35.329450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-010ccbcd-a7f4-46a2-88e0-570500e486d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:35.458517 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-010ccbcd-a7f4-46a2-88e0-570500e486d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:35.467150 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-010ccbcd-a7f4-46a2-88e0-570500e486d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1731 microversion: 2.1 time: 0.154258 Oct 04 03:33:35.467729 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 273/541] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:35 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:35.489781 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-64d3f973-3f78-4803-9e0f-83b52560d1fe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:35.490282 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-64d3f973-3f78-4803-9e0f-83b52560d1fe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:35.497107 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-64d3f973-3f78-4803-9e0f-83b52560d1fe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:35.497609 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-64d3f973-3f78-4803-9e0f-83b52560d1fe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:35.498056 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-64d3f973-3f78-4803-9e0f-83b52560d1fe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:35.498727 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-64d3f973-3f78-4803-9e0f-83b52560d1fe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:35.499170 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-64d3f973-3f78-4803-9e0f-83b52560d1fe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:35.499617 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-64d3f973-3f78-4803-9e0f-83b52560d1fe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:35.579512 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-64d3f973-3f78-4803-9e0f-83b52560d1fe tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093419 Oct 04 03:33:35.580111 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 269/542] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Oct 4 03:33:35 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:35.858483 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-97aaf830-6d6b-446b-a086-0c0731aca969 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:35.859116 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-97aaf830-6d6b-446b-a086-0c0731aca969 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:35.865179 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97aaf830-6d6b-446b-a086-0c0731aca969 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:35.865662 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97aaf830-6d6b-446b-a086-0c0731aca969 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:35.866093 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97aaf830-6d6b-446b-a086-0c0731aca969 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:35.866784 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97aaf830-6d6b-446b-a086-0c0731aca969 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:35.867235 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97aaf830-6d6b-446b-a086-0c0731aca969 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:35.867687 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97aaf830-6d6b-446b-a086-0c0731aca969 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:35.929155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-97aaf830-6d6b-446b-a086-0c0731aca969 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:35.937697 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-97aaf830-6d6b-446b-a086-0c0731aca969 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:35.939139 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-97aaf830-6d6b-446b-a086-0c0731aca969 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:35.940251 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-97aaf830-6d6b-446b-a086-0c0731aca969 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1339 microversion: 2.20 time: 0.085763 Oct 04 03:33:35.940807 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 274/543] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:35 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:36.713913 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-c6076fd5-c294-4b35-a29a-c5cccbc8365c req-24c15e05-28c5-4d7f-8c0c-8ee97e547bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36a2b849-4aeb-4b38-8204-9a1b6c3983d8", "tag": "c33a6354-d3b9-46e0-8da8-baff5c9a347a"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:36.724738 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-c6076fd5-c294-4b35-a29a-c5cccbc8365c req-24c15e05-28c5-4d7f-8c0c-8ee97e547bc4 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:36.725436 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-c6076fd5-c294-4b35-a29a-c5cccbc8365c req-24c15e05-28c5-4d7f-8c0c-8ee97e547bc4 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:36.726037 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-c6076fd5-c294-4b35-a29a-c5cccbc8365c req-24c15e05-28c5-4d7f-8c0c-8ee97e547bc4 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:36.739016 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-c6076fd5-c294-4b35-a29a-c5cccbc8365c req-24c15e05-28c5-4d7f-8c0c-8ee97e547bc4 service nova] Creating event network-changed:c33a6354-d3b9-46e0-8da8-baff5c9a347a for instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 on hv-cinder-84914 Oct 04 03:33:36.744621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-c6076fd5-c294-4b35-a29a-c5cccbc8365c req-24c15e05-28c5-4d7f-8c0c-8ee97e547bc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034498 Oct 04 03:33:36.745734 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 270/544] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:36.966888 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-619c93d3-c210-46e3-a12a-8c9d45e12cc7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:36.967703 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-619c93d3-c210-46e3-a12a-8c9d45e12cc7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:36.975968 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-619c93d3-c210-46e3-a12a-8c9d45e12cc7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:36.976471 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-619c93d3-c210-46e3-a12a-8c9d45e12cc7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:36.976903 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-619c93d3-c210-46e3-a12a-8c9d45e12cc7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:36.977612 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-619c93d3-c210-46e3-a12a-8c9d45e12cc7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:36.978112 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-619c93d3-c210-46e3-a12a-8c9d45e12cc7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:36.978728 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-619c93d3-c210-46e3-a12a-8c9d45e12cc7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:37.086429 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-619c93d3-c210-46e3-a12a-8c9d45e12cc7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:37.097186 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-619c93d3-c210-46e3-a12a-8c9d45e12cc7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:37.099946 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-619c93d3-c210-46e3-a12a-8c9d45e12cc7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:37.101414 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-619c93d3-c210-46e3-a12a-8c9d45e12cc7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1339 microversion: 2.20 time: 0.139231 Oct 04 03:33:37.111528 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 275/545] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:36 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1339 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:38.107869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-b26eb9b5-0198-4c0e-9410-bc6f84d51b3a req-18903e29-709e-4e77-932d-d5b98df59fb3 admin admin] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:38.111205 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-b26eb9b5-0198-4c0e-9410-bc6f84d51b3a req-18903e29-709e-4e77-932d-d5b98df59fb3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:38.111712 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-b26eb9b5-0198-4c0e-9410-bc6f84d51b3a req-18903e29-709e-4e77-932d-d5b98df59fb3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:38.112142 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-b26eb9b5-0198-4c0e-9410-bc6f84d51b3a req-18903e29-709e-4e77-932d-d5b98df59fb3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:38.121199 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-b26eb9b5-0198-4c0e-9410-bc6f84d51b3a req-18903e29-709e-4e77-932d-d5b98df59fb3 admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:38.121667 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-b26eb9b5-0198-4c0e-9410-bc6f84d51b3a req-18903e29-709e-4e77-932d-d5b98df59fb3 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:38.122118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-b26eb9b5-0198-4c0e-9410-bc6f84d51b3a req-18903e29-709e-4e77-932d-d5b98df59fb3 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:38.128585 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-161cb1b0-dfd4-4d75-bdab-caca25be3160 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:38.129314 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-161cb1b0-dfd4-4d75-bdab-caca25be3160 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:38.136214 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-161cb1b0-dfd4-4d75-bdab-caca25be3160 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:38.136844 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-161cb1b0-dfd4-4d75-bdab-caca25be3160 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:38.137379 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-161cb1b0-dfd4-4d75-bdab-caca25be3160 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:38.138242 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-161cb1b0-dfd4-4d75-bdab-caca25be3160 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:38.138591 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-b26eb9b5-0198-4c0e-9410-bc6f84d51b3a req-18903e29-709e-4e77-932d-d5b98df59fb3 admin admin] 10.222.0.33 "DELETE /compute/v2.1/os-assisted-volume-snapshots/f4bd4833-7bd9-4af0-8ebb-8c9a55654ab9?delete_info=%7B%22file_to_merge%22:%20%22volume-059ce37a-ae85-497b-8f2b-15254704cd13.f4bd4833-7bd9-4af0-8ebb-8c9a55654ab9.vhdx%22,%20%22volume_id%22:%20%22059ce37a-ae85-497b-8f2b-15254704cd13%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.084582 Oct 04 03:33:38.139042 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-161cb1b0-dfd4-4d75-bdab-caca25be3160 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:38.139604 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-161cb1b0-dfd4-4d75-bdab-caca25be3160 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:38.139815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 271/546] 10.222.0.33 () {62 vars in 1800 bytes} [Tue Oct 4 03:33:38 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/f4bd4833-7bd9-4af0-8ebb-8c9a55654ab9?delete_info=%7B%22file_to_merge%22:%20%22volume-059ce37a-ae85-497b-8f2b-15254704cd13.f4bd4833-7bd9-4af0-8ebb-8c9a55654ab9.vhdx%22,%20%22volume_id%22:%20%22059ce37a-ae85-497b-8f2b-15254704cd13%22%7D => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 03:33:38.621518 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-161cb1b0-dfd4-4d75-bdab-caca25be3160 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:38.629660 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-161cb1b0-dfd4-4d75-bdab-caca25be3160 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:38.631321 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-161cb1b0-dfd4-4d75-bdab-caca25be3160 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:38.632449 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-161cb1b0-dfd4-4d75-bdab-caca25be3160 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1406 microversion: 2.20 time: 0.507802 Oct 04 03:33:38.633005 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 276/547] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:38 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1406 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:33:38.760590 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-862e1380-c82d-439f-8454-2b7418671f21 req-c82586c6-2452-41ed-b387-d2f3f819c0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36a2b849-4aeb-4b38-8204-9a1b6c3983d8", "tag": "c33a6354-d3b9-46e0-8da8-baff5c9a347a"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:38.765557 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:DELETE=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:38.771809 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-862e1380-c82d-439f-8454-2b7418671f21 req-c82586c6-2452-41ed-b387-d2f3f819c0e1 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:38.772511 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-862e1380-c82d-439f-8454-2b7418671f21 req-c82586c6-2452-41ed-b387-d2f3f819c0e1 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:38.772967 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-862e1380-c82d-439f-8454-2b7418671f21 req-c82586c6-2452-41ed-b387-d2f3f819c0e1 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:38.785066 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-862e1380-c82d-439f-8454-2b7418671f21 req-c82586c6-2452-41ed-b387-d2f3f819c0e1 service nova] Creating event network-changed:c33a6354-d3b9-46e0-8da8-baff5c9a347a for instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 on hv-cinder-84914 Oct 04 03:33:38.790283 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-862e1380-c82d-439f-8454-2b7418671f21 req-c82586c6-2452-41ed-b387-d2f3f819c0e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034115 Oct 04 03:33:38.791055 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 272/548] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:38.888984 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-090cadc2-2a15-42ae-873b-477784bf744b req-5d6c9a95-6387-4692-96c9-59c6e2bae816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8528cda6-7d7e-4973-b37c-bcfccbd9351d", "tag": "f9bf7419-15c5-4815-98c4-9e6466299270"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:38.901051 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-090cadc2-2a15-42ae-873b-477784bf744b req-5d6c9a95-6387-4692-96c9-59c6e2bae816 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:38.901523 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-090cadc2-2a15-42ae-873b-477784bf744b req-5d6c9a95-6387-4692-96c9-59c6e2bae816 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:38.901957 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-090cadc2-2a15-42ae-873b-477784bf744b req-5d6c9a95-6387-4692-96c9-59c6e2bae816 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:38.920848 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-090cadc2-2a15-42ae-873b-477784bf744b req-5d6c9a95-6387-4692-96c9-59c6e2bae816 service nova] Creating event network-changed:f9bf7419-15c5-4815-98c4-9e6466299270 for instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d on hv-cinder-84914 Oct 04 03:33:38.925932 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-090cadc2-2a15-42ae-873b-477784bf744b req-5d6c9a95-6387-4692-96c9-59c6e2bae816 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040521 Oct 04 03:33:38.926693 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 277/549] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:39.659233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a43d9d12-6547-4db2-a989-e28ca47db9f7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:39.659991 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a43d9d12-6547-4db2-a989-e28ca47db9f7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:39.666376 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a43d9d12-6547-4db2-a989-e28ca47db9f7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:39.666854 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a43d9d12-6547-4db2-a989-e28ca47db9f7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:39.667285 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a43d9d12-6547-4db2-a989-e28ca47db9f7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:39.667989 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a43d9d12-6547-4db2-a989-e28ca47db9f7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:39.668442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a43d9d12-6547-4db2-a989-e28ca47db9f7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:39.668865 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a43d9d12-6547-4db2-a989-e28ca47db9f7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:39.797874 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a43d9d12-6547-4db2-a989-e28ca47db9f7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:39.806570 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a43d9d12-6547-4db2-a989-e28ca47db9f7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:39.808397 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a43d9d12-6547-4db2-a989-e28ca47db9f7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:39.809621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a43d9d12-6547-4db2-a989-e28ca47db9f7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1406 microversion: 2.20 time: 0.155047 Oct 04 03:33:39.810253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 273/550] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:39 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:40.833869 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:40.839113 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7d0d368f-fc9a-4a6f-bab7-6b0814581622 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:40.839844 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7d0d368f-fc9a-4a6f-bab7-6b0814581622 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:40.846110 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d0d368f-fc9a-4a6f-bab7-6b0814581622 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:40.846584 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d0d368f-fc9a-4a6f-bab7-6b0814581622 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:40.847011 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d0d368f-fc9a-4a6f-bab7-6b0814581622 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:40.847714 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d0d368f-fc9a-4a6f-bab7-6b0814581622 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:40.848167 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d0d368f-fc9a-4a6f-bab7-6b0814581622 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:40.848579 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d0d368f-fc9a-4a6f-bab7-6b0814581622 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:40.973318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-7d0d368f-fc9a-4a6f-bab7-6b0814581622 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:40.982191 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-7d0d368f-fc9a-4a6f-bab7-6b0814581622 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:40.983737 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-7d0d368f-fc9a-4a6f-bab7-6b0814581622 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:40.984838 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7d0d368f-fc9a-4a6f-bab7-6b0814581622 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1406 microversion: 2.20 time: 0.152403 Oct 04 03:33:40.985399 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 278/551] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:40 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:42.010495 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c11249d0-5f2b-49db-b227-edc9e3e1a89a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:42.011166 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c11249d0-5f2b-49db-b227-edc9e3e1a89a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:42.013803 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=10 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:42.019671 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c11249d0-5f2b-49db-b227-edc9e3e1a89a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:42.020478 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c11249d0-5f2b-49db-b227-edc9e3e1a89a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:42.020860 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c11249d0-5f2b-49db-b227-edc9e3e1a89a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:42.021759 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c11249d0-5f2b-49db-b227-edc9e3e1a89a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:42.022429 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c11249d0-5f2b-49db-b227-edc9e3e1a89a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:42.023057 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c11249d0-5f2b-49db-b227-edc9e3e1a89a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:42.245137 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c11249d0-5f2b-49db-b227-edc9e3e1a89a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:42.253490 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c11249d0-5f2b-49db-b227-edc9e3e1a89a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:42.254931 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c11249d0-5f2b-49db-b227-edc9e3e1a89a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:42.256059 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c11249d0-5f2b-49db-b227-edc9e3e1a89a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1406 microversion: 2.20 time: 0.249733 Oct 04 03:33:42.256609 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 274/552] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:42 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:43.281880 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-841d36ff-548d-462e-a595-fa1ec962295b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:43.282478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-841d36ff-548d-462e-a595-fa1ec962295b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:43.284573 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:43.290490 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-841d36ff-548d-462e-a595-fa1ec962295b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:43.291064 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-841d36ff-548d-462e-a595-fa1ec962295b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:43.291372 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-841d36ff-548d-462e-a595-fa1ec962295b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:43.292251 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-841d36ff-548d-462e-a595-fa1ec962295b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:43.292701 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-841d36ff-548d-462e-a595-fa1ec962295b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:43.293115 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-841d36ff-548d-462e-a595-fa1ec962295b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:43.330694 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-8e8dcdbd-10d6-4dfd-addd-d3c11b0a7b15 req-cd901420-e593-428b-96b3-98afff7b3d68 admin admin] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:43.334113 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-8e8dcdbd-10d6-4dfd-addd-d3c11b0a7b15 req-cd901420-e593-428b-96b3-98afff7b3d68 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:43.334570 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-8e8dcdbd-10d6-4dfd-addd-d3c11b0a7b15 req-cd901420-e593-428b-96b3-98afff7b3d68 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:43.334992 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-8e8dcdbd-10d6-4dfd-addd-d3c11b0a7b15 req-cd901420-e593-428b-96b3-98afff7b3d68 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:43.343953 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-8e8dcdbd-10d6-4dfd-addd-d3c11b0a7b15 req-cd901420-e593-428b-96b3-98afff7b3d68 admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:43.344421 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-8e8dcdbd-10d6-4dfd-addd-d3c11b0a7b15 req-cd901420-e593-428b-96b3-98afff7b3d68 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:43.344845 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-8e8dcdbd-10d6-4dfd-addd-d3c11b0a7b15 req-cd901420-e593-428b-96b3-98afff7b3d68 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:43.359016 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-8e8dcdbd-10d6-4dfd-addd-d3c11b0a7b15 req-cd901420-e593-428b-96b3-98afff7b3d68 admin admin] 10.222.0.33 "DELETE /compute/v2.1/os-assisted-volume-snapshots/f8d04f1e-9197-4a77-a611-75aa189efded?delete_info=%7B%22file_to_merge%22:%20%22volume-059ce37a-ae85-497b-8f2b-15254704cd13.f8d04f1e-9197-4a77-a611-75aa189efded.vhdx%22,%20%22volume_id%22:%20%22059ce37a-ae85-497b-8f2b-15254704cd13%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.079798 Oct 04 03:33:43.359612 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 275/553] 10.222.0.33 () {62 vars in 1800 bytes} [Tue Oct 4 03:33:43 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/f8d04f1e-9197-4a77-a611-75aa189efded?delete_info=%7B%22file_to_merge%22:%20%22volume-059ce37a-ae85-497b-8f2b-15254704cd13.f8d04f1e-9197-4a77-a611-75aa189efded.vhdx%22,%20%22volume_id%22:%20%22059ce37a-ae85-497b-8f2b-15254704cd13%22%7D => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 03:33:43.426431 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-841d36ff-548d-462e-a595-fa1ec962295b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:43.435306 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-841d36ff-548d-462e-a595-fa1ec962295b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:43.436754 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-841d36ff-548d-462e-a595-fa1ec962295b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:43.437841 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-841d36ff-548d-462e-a595-fa1ec962295b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1406 microversion: 2.20 time: 0.160018 Oct 04 03:33:43.438388 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 279/554] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:43 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:44.464822 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-663191d5-ba9e-44cc-9974-5f451a20b7e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:44.465528 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-663191d5-ba9e-44cc-9974-5f451a20b7e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:44.471612 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-663191d5-ba9e-44cc-9974-5f451a20b7e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:44.472086 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-663191d5-ba9e-44cc-9974-5f451a20b7e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:44.472512 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-663191d5-ba9e-44cc-9974-5f451a20b7e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:44.473188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-663191d5-ba9e-44cc-9974-5f451a20b7e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:44.473629 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-663191d5-ba9e-44cc-9974-5f451a20b7e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:44.474044 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-663191d5-ba9e-44cc-9974-5f451a20b7e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:44.606968 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-663191d5-ba9e-44cc-9974-5f451a20b7e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:44.614852 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-663191d5-ba9e-44cc-9974-5f451a20b7e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:44.616298 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-663191d5-ba9e-44cc-9974-5f451a20b7e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:44.617385 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-663191d5-ba9e-44cc-9974-5f451a20b7e8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1406 microversion: 2.20 time: 0.157952 Oct 04 03:33:44.617938 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 276/555] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:44 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:45.642109 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6062643d-788a-4258-82b3-63cf7a7c710b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:45.642746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6062643d-788a-4258-82b3-63cf7a7c710b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:45.649257 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6062643d-788a-4258-82b3-63cf7a7c710b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:45.649745 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6062643d-788a-4258-82b3-63cf7a7c710b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:45.650176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6062643d-788a-4258-82b3-63cf7a7c710b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:45.650861 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6062643d-788a-4258-82b3-63cf7a7c710b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:45.651312 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6062643d-788a-4258-82b3-63cf7a7c710b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:45.651760 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6062643d-788a-4258-82b3-63cf7a7c710b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:45.780203 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6062643d-788a-4258-82b3-63cf7a7c710b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:45.788110 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6062643d-788a-4258-82b3-63cf7a7c710b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:45.789542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6062643d-788a-4258-82b3-63cf7a7c710b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:45.790976 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6062643d-788a-4258-82b3-63cf7a7c710b tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1406 microversion: 2.20 time: 0.152756 Oct 04 03:33:45.791575 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 280/556] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:45 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:46.816159 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-312c5f5d-8107-4a8d-8367-aff1abb3ed82 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:46.816759 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-312c5f5d-8107-4a8d-8367-aff1abb3ed82 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:46.824021 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-312c5f5d-8107-4a8d-8367-aff1abb3ed82 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:46.824493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-312c5f5d-8107-4a8d-8367-aff1abb3ed82 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:46.824921 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-312c5f5d-8107-4a8d-8367-aff1abb3ed82 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:46.825595 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-312c5f5d-8107-4a8d-8367-aff1abb3ed82 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:46.826035 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-312c5f5d-8107-4a8d-8367-aff1abb3ed82 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:46.826448 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-312c5f5d-8107-4a8d-8367-aff1abb3ed82 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:46.952395 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-312c5f5d-8107-4a8d-8367-aff1abb3ed82 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:46.960214 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-312c5f5d-8107-4a8d-8367-aff1abb3ed82 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:46.961633 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-312c5f5d-8107-4a8d-8367-aff1abb3ed82 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:46.963338 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-312c5f5d-8107-4a8d-8367-aff1abb3ed82 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1406 microversion: 2.20 time: 0.151037 Oct 04 03:33:46.963919 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 277/557] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:46 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:47.534629 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-fe477789-fd59-4583-86d9-dff1f272d995 req-2e83a691-5b0d-47fb-8ef1-9a57ebf2c556 admin admin] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:47.538027 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fe477789-fd59-4583-86d9-dff1f272d995 req-2e83a691-5b0d-47fb-8ef1-9a57ebf2c556 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:47.538513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fe477789-fd59-4583-86d9-dff1f272d995 req-2e83a691-5b0d-47fb-8ef1-9a57ebf2c556 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:47.538940 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fe477789-fd59-4583-86d9-dff1f272d995 req-2e83a691-5b0d-47fb-8ef1-9a57ebf2c556 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:47.547223 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fe477789-fd59-4583-86d9-dff1f272d995 req-2e83a691-5b0d-47fb-8ef1-9a57ebf2c556 admin admin] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:47.547725 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fe477789-fd59-4583-86d9-dff1f272d995 req-2e83a691-5b0d-47fb-8ef1-9a57ebf2c556 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:47.548155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fe477789-fd59-4583-86d9-dff1f272d995 req-2e83a691-5b0d-47fb-8ef1-9a57ebf2c556 admin admin] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:47.561566 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-fe477789-fd59-4583-86d9-dff1f272d995 req-2e83a691-5b0d-47fb-8ef1-9a57ebf2c556 admin admin] 10.222.0.33 "DELETE /compute/v2.1/os-assisted-volume-snapshots/d1418044-92c2-4831-a4e2-4fb1f0a9a812?delete_info=%7B%22file_to_merge%22:%20%22volume-059ce37a-ae85-497b-8f2b-15254704cd13.d1418044-92c2-4831-a4e2-4fb1f0a9a812.vhdx%22,%20%22volume_id%22:%20%22059ce37a-ae85-497b-8f2b-15254704cd13%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.075279 Oct 04 03:33:47.562127 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 281/558] 10.222.0.33 () {62 vars in 1800 bytes} [Tue Oct 4 03:33:47 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/d1418044-92c2-4831-a4e2-4fb1f0a9a812?delete_info=%7B%22file_to_merge%22:%20%22volume-059ce37a-ae85-497b-8f2b-15254704cd13.d1418044-92c2-4831-a4e2-4fb1f0a9a812.vhdx%22,%20%22volume_id%22:%20%22059ce37a-ae85-497b-8f2b-15254704cd13%22%7D => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:33:47.989607 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0e066a7a-8716-47ec-b455-34d62a7f83b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:47.990200 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-0e066a7a-8716-47ec-b455-34d62a7f83b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:47.996581 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e066a7a-8716-47ec-b455-34d62a7f83b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:47.997053 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e066a7a-8716-47ec-b455-34d62a7f83b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:47.997478 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e066a7a-8716-47ec-b455-34d62a7f83b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:47.998150 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e066a7a-8716-47ec-b455-34d62a7f83b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:47.998588 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e066a7a-8716-47ec-b455-34d62a7f83b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:47.998999 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e066a7a-8716-47ec-b455-34d62a7f83b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:48.127721 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0e066a7a-8716-47ec-b455-34d62a7f83b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:48.136882 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0e066a7a-8716-47ec-b455-34d62a7f83b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:48.138313 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0e066a7a-8716-47ec-b455-34d62a7f83b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:48.139402 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0e066a7a-8716-47ec-b455-34d62a7f83b6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1406 microversion: 2.20 time: 0.153655 Oct 04 03:33:48.139992 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 278/559] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:47 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:48.288579 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-1f258df8-cd3c-46e9-b7ec-efb1950ee6b5 req-c9d2ef8f-ab42-439b-ac0e-a303c8ac90bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528cda6-7d7e-4973-b37c-bcfccbd9351d", "name": "network-vif-plugged", "status": "completed", "tag": "f9bf7419-15c5-4815-98c4-9e6466299270"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:48.298570 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-1f258df8-cd3c-46e9-b7ec-efb1950ee6b5 req-c9d2ef8f-ab42-439b-ac0e-a303c8ac90bb service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:48.299064 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-1f258df8-cd3c-46e9-b7ec-efb1950ee6b5 req-c9d2ef8f-ab42-439b-ac0e-a303c8ac90bb service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:48.299523 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-1f258df8-cd3c-46e9-b7ec-efb1950ee6b5 req-c9d2ef8f-ab42-439b-ac0e-a303c8ac90bb service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:48.311512 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-1f258df8-cd3c-46e9-b7ec-efb1950ee6b5 req-c9d2ef8f-ab42-439b-ac0e-a303c8ac90bb service nova] Creating event network-vif-plugged:f9bf7419-15c5-4815-98c4-9e6466299270 for instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d on hv-cinder-84914 Oct 04 03:33:48.316213 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-1f258df8-cd3c-46e9-b7ec-efb1950ee6b5 req-c9d2ef8f-ab42-439b-ac0e-a303c8ac90bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031745 Oct 04 03:33:48.316798 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 282/560] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:49.166374 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d53fe76a-1ccf-4ac7-9762-d0d571f6b7b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:49.167837 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d53fe76a-1ccf-4ac7-9762-d0d571f6b7b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:49.174222 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d53fe76a-1ccf-4ac7-9762-d0d571f6b7b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:49.174705 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d53fe76a-1ccf-4ac7-9762-d0d571f6b7b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:49.175135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d53fe76a-1ccf-4ac7-9762-d0d571f6b7b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:49.175853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d53fe76a-1ccf-4ac7-9762-d0d571f6b7b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:49.176308 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d53fe76a-1ccf-4ac7-9762-d0d571f6b7b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:49.176726 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d53fe76a-1ccf-4ac7-9762-d0d571f6b7b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:49.318640 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d53fe76a-1ccf-4ac7-9762-d0d571f6b7b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:49.327302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d53fe76a-1ccf-4ac7-9762-d0d571f6b7b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:49.328777 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d53fe76a-1ccf-4ac7-9762-d0d571f6b7b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:49.329868 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d53fe76a-1ccf-4ac7-9762-d0d571f6b7b5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1406 microversion: 2.20 time: 0.168993 Oct 04 03:33:49.330418 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 279/561] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:49 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:50.358096 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d01364b5-4545-42bd-8d4b-7ef097c70713 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:50.358707 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d01364b5-4545-42bd-8d4b-7ef097c70713 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:50.365580 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d01364b5-4545-42bd-8d4b-7ef097c70713 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:50.366062 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d01364b5-4545-42bd-8d4b-7ef097c70713 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:50.366495 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d01364b5-4545-42bd-8d4b-7ef097c70713 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:50.367183 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d01364b5-4545-42bd-8d4b-7ef097c70713 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:50.367668 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d01364b5-4545-42bd-8d4b-7ef097c70713 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:50.368732 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d01364b5-4545-42bd-8d4b-7ef097c70713 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:50.468264 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-52bb6bb8-4b1b-4736-837a-84af7606e9a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:50.470448 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-52bb6bb8-4b1b-4736-837a-84af7606e9a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:50.476750 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-52bb6bb8-4b1b-4736-837a-84af7606e9a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:50.477227 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-52bb6bb8-4b1b-4736-837a-84af7606e9a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:50.478293 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-52bb6bb8-4b1b-4736-837a-84af7606e9a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:50.478978 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-52bb6bb8-4b1b-4736-837a-84af7606e9a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:50.479418 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-52bb6bb8-4b1b-4736-837a-84af7606e9a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:50.479858 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-52bb6bb8-4b1b-4736-837a-84af7606e9a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:50.506074 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-d01364b5-4545-42bd-8d4b-7ef097c70713 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:50.515969 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-d01364b5-4545-42bd-8d4b-7ef097c70713 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:50.517507 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-d01364b5-4545-42bd-8d4b-7ef097c70713 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:50.518606 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d01364b5-4545-42bd-8d4b-7ef097c70713 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1406 microversion: 2.20 time: 0.166479 Oct 04 03:33:50.519463 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 283/562] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:50 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:50.523912 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-52bb6bb8-4b1b-4736-837a-84af7606e9a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059407 Oct 04 03:33:50.524082 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7987e02d-a4c1-41fc-8930-919fb5435536 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:50.524959 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7987e02d-a4c1-41fc-8930-919fb5435536 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:50.525314 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 280/563] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:33:50 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 03:33:50.530901 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7987e02d-a4c1-41fc-8930-919fb5435536 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:50.531394 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7987e02d-a4c1-41fc-8930-919fb5435536 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:50.532085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7987e02d-a4c1-41fc-8930-919fb5435536 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:50.532765 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7987e02d-a4c1-41fc-8930-919fb5435536 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:50.533206 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7987e02d-a4c1-41fc-8930-919fb5435536 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:50.533621 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7987e02d-a4c1-41fc-8930-919fb5435536 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:50.590935 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-5b872ac0-ed17-47ab-acce-31981cc2c4d2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:50.591427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-5b872ac0-ed17-47ab-acce-31981cc2c4d2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:50.597227 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5b872ac0-ed17-47ab-acce-31981cc2c4d2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:50.597709 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5b872ac0-ed17-47ab-acce-31981cc2c4d2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:50.598347 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5b872ac0-ed17-47ab-acce-31981cc2c4d2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:50.599033 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5b872ac0-ed17-47ab-acce-31981cc2c4d2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:50.599506 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5b872ac0-ed17-47ab-acce-31981cc2c4d2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:50.599931 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5b872ac0-ed17-47ab-acce-31981cc2c4d2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:50.616462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-7987e02d-a4c1-41fc-8930-919fb5435536 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lazy-loading 'services' on Instance uuid fbd62e87-038e-4701-a33e-81e924d68abd {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:33:50.625325 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-5b872ac0-ed17-47ab-acce-31981cc2c4d2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Going to try to terminate instance {{(pid=120595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:33:50.688714 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7987e02d-a4c1-41fc-8930-919fb5435536 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd/os-volume_attachments/059ce37a-ae85-497b-8f2b-15254704cd13" status: 202 len: 0 microversion: 2.1 time: 0.168032 Oct 04 03:33:50.689401 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 284/564] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Oct 4 03:33:50 2022] DELETE /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd/os-volume_attachments/059ce37a-ae85-497b-8f2b-15254704cd13 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:33:50.705520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-5b872ac0-ed17-47ab-acce-31981cc2c4d2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 204 len: 0 microversion: 2.1 time: 0.118609 Oct 04 03:33:50.706292 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 281/565] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:33:50 2022] DELETE /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 03:33:50.715322 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-38d99d44-f07b-4bbf-8bbc-e626d4d261b3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:50.716065 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-38d99d44-f07b-4bbf-8bbc-e626d4d261b3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:50.722195 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-38d99d44-f07b-4bbf-8bbc-e626d4d261b3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:50.722682 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-38d99d44-f07b-4bbf-8bbc-e626d4d261b3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:50.723121 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-38d99d44-f07b-4bbf-8bbc-e626d4d261b3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:50.723867 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-38d99d44-f07b-4bbf-8bbc-e626d4d261b3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:50.724320 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-38d99d44-f07b-4bbf-8bbc-e626d4d261b3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:50.725084 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-38d99d44-f07b-4bbf-8bbc-e626d4d261b3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:50.851031 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-38d99d44-f07b-4bbf-8bbc-e626d4d261b3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:50.860965 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-38d99d44-f07b-4bbf-8bbc-e626d4d261b3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1672 microversion: 2.1 time: 0.150305 Oct 04 03:33:50.861541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 285/566] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:50 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:51.544368 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-4a2948f6-7bb1-4143-b410-3cc4f9c1872f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:51.545061 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-4a2948f6-7bb1-4143-b410-3cc4f9c1872f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:51.551322 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4a2948f6-7bb1-4143-b410-3cc4f9c1872f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:51.551840 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4a2948f6-7bb1-4143-b410-3cc4f9c1872f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:51.552279 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4a2948f6-7bb1-4143-b410-3cc4f9c1872f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:51.552960 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4a2948f6-7bb1-4143-b410-3cc4f9c1872f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:51.553414 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4a2948f6-7bb1-4143-b410-3cc4f9c1872f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:51.553829 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4a2948f6-7bb1-4143-b410-3cc4f9c1872f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:51.681962 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4a2948f6-7bb1-4143-b410-3cc4f9c1872f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:51.689916 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4a2948f6-7bb1-4143-b410-3cc4f9c1872f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:51.691640 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4a2948f6-7bb1-4143-b410-3cc4f9c1872f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:51.693048 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-4a2948f6-7bb1-4143-b410-3cc4f9c1872f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1597 microversion: 2.20 time: 0.153357 Oct 04 03:33:51.694133 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 282/567] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:33:51 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1597 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:33:51.719944 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f289e5a6-f21f-45fa-8967-3805656ce3b9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:51.720442 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f289e5a6-f21f-45fa-8967-3805656ce3b9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:51.722837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:51.728953 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f289e5a6-f21f-45fa-8967-3805656ce3b9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:51.729481 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f289e5a6-f21f-45fa-8967-3805656ce3b9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:51.730056 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f289e5a6-f21f-45fa-8967-3805656ce3b9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:51.730750 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f289e5a6-f21f-45fa-8967-3805656ce3b9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:51.731204 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f289e5a6-f21f-45fa-8967-3805656ce3b9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:51.731683 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f289e5a6-f21f-45fa-8967-3805656ce3b9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:51.735893 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:51.815920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f289e5a6-f21f-45fa-8967-3805656ce3b9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099807 Oct 04 03:33:51.816511 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 286/568] 10.222.0.25 () {60 vars in 1316 bytes} [Tue Oct 4 03:33:51 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:33:51.885650 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-942ee81b-9c55-4f60-92d1-268ec0a3485d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:51.886258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-942ee81b-9c55-4f60-92d1-268ec0a3485d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:51.892151 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-942ee81b-9c55-4f60-92d1-268ec0a3485d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:51.892912 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-942ee81b-9c55-4f60-92d1-268ec0a3485d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:51.893347 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-942ee81b-9c55-4f60-92d1-268ec0a3485d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:51.894026 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-942ee81b-9c55-4f60-92d1-268ec0a3485d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:51.894472 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-942ee81b-9c55-4f60-92d1-268ec0a3485d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:51.894888 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-942ee81b-9c55-4f60-92d1-268ec0a3485d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:52.121784 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-942ee81b-9c55-4f60-92d1-268ec0a3485d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:52.129461 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-942ee81b-9c55-4f60-92d1-268ec0a3485d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1672 microversion: 2.1 time: 0.247968 Oct 04 03:33:52.130028 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 283/569] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:51 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1672 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:53.038418 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-5211a69a-effc-4204-b555-481ac2ec582f req-98715637-e20e-4573-9151-d5de0edff413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8528cda6-7d7e-4973-b37c-bcfccbd9351d", "tag": "f9bf7419-15c5-4815-98c4-9e6466299270"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:53.048464 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-5211a69a-effc-4204-b555-481ac2ec582f req-98715637-e20e-4573-9151-d5de0edff413 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:53.048936 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-5211a69a-effc-4204-b555-481ac2ec582f req-98715637-e20e-4573-9151-d5de0edff413 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:53.049357 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-5211a69a-effc-4204-b555-481ac2ec582f req-98715637-e20e-4573-9151-d5de0edff413 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:53.061059 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-5211a69a-effc-4204-b555-481ac2ec582f req-98715637-e20e-4573-9151-d5de0edff413 service nova] Creating event network-changed:f9bf7419-15c5-4815-98c4-9e6466299270 for instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d on hv-cinder-84914 Oct 04 03:33:53.065864 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-5211a69a-effc-4204-b555-481ac2ec582f req-98715637-e20e-4573-9151-d5de0edff413 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031550 Oct 04 03:33:53.066452 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 287/570] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:33:53.153608 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b52e41ab-7947-42bf-b874-8827bafa90c4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:53.154218 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b52e41ab-7947-42bf-b874-8827bafa90c4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:53.160504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b52e41ab-7947-42bf-b874-8827bafa90c4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:53.160990 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b52e41ab-7947-42bf-b874-8827bafa90c4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:53.161431 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b52e41ab-7947-42bf-b874-8827bafa90c4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:53.162122 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b52e41ab-7947-42bf-b874-8827bafa90c4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:53.162574 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b52e41ab-7947-42bf-b874-8827bafa90c4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:53.163000 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b52e41ab-7947-42bf-b874-8827bafa90c4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:53.295211 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b52e41ab-7947-42bf-b874-8827bafa90c4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:53.302907 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b52e41ab-7947-42bf-b874-8827bafa90c4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1672 microversion: 2.1 time: 0.153197 Oct 04 03:33:53.303478 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 284/571] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:53 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:54.330085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0a5d3053-f3cf-4191-a95b-0f4c07f1ba6b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:54.330914 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0a5d3053-f3cf-4191-a95b-0f4c07f1ba6b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:54.337568 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a5d3053-f3cf-4191-a95b-0f4c07f1ba6b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:54.338567 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a5d3053-f3cf-4191-a95b-0f4c07f1ba6b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:54.339079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a5d3053-f3cf-4191-a95b-0f4c07f1ba6b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:54.340440 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a5d3053-f3cf-4191-a95b-0f4c07f1ba6b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:54.341102 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a5d3053-f3cf-4191-a95b-0f4c07f1ba6b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:54.341737 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a5d3053-f3cf-4191-a95b-0f4c07f1ba6b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:54.587301 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-0a5d3053-f3cf-4191-a95b-0f4c07f1ba6b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:54.595260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0a5d3053-f3cf-4191-a95b-0f4c07f1ba6b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1672 microversion: 2.1 time: 0.270356 Oct 04 03:33:54.595898 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 288/572] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:54 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1672 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:55.008673 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-ffec2fad-d568-4779-a101-717e58809c5f tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:55.009469 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-ffec2fad-d568-4779-a101-717e58809c5f tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:55.014611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=8 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:55.021260 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ffec2fad-d568-4779-a101-717e58809c5f tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:55.021752 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ffec2fad-d568-4779-a101-717e58809c5f tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:55.022223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ffec2fad-d568-4779-a101-717e58809c5f tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:55.022986 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ffec2fad-d568-4779-a101-717e58809c5f tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:55.023508 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ffec2fad-d568-4779-a101-717e58809c5f tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:55.023873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ffec2fad-d568-4779-a101-717e58809c5f tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:55.052738 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-ffec2fad-d568-4779-a101-717e58809c5f tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Going to try to terminate instance {{(pid=120595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:33:55.085652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-750dea38-7a4c-4779-9665-c2fedb734cad req-6c849655-fecf-4e1c-8a13-0d3945964a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d49bbae-bf97-4c67-a54a-3625acee0ba0", "name": "network-vif-deleted", "tag": "e0fdb780-8d0f-42bb-84b6-8c188eade731"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:33:55.098836 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-750dea38-7a4c-4779-9665-c2fedb734cad req-6c849655-fecf-4e1c-8a13-0d3945964a16 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:55.101670 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:55.105999 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-750dea38-7a4c-4779-9665-c2fedb734cad req-6c849655-fecf-4e1c-8a13-0d3945964a16 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:55.106772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-750dea38-7a4c-4779-9665-c2fedb734cad req-6c849655-fecf-4e1c-8a13-0d3945964a16 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:55.132009 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-750dea38-7a4c-4779-9665-c2fedb734cad req-6c849655-fecf-4e1c-8a13-0d3945964a16 service nova] Creating event network-vif-deleted:e0fdb780-8d0f-42bb-84b6-8c188eade731 for instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 on hv-cinder-84914 Oct 04 03:33:55.146487 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-750dea38-7a4c-4779-9665-c2fedb734cad req-6c849655-fecf-4e1c-8a13-0d3945964a16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064706 Oct 04 03:33:55.147381 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 289/573] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:33:55.210415 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-ffec2fad-d568-4779-a101-717e58809c5f tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 204 len: 0 microversion: 2.1 time: 0.205300 Oct 04 03:33:55.211001 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 285/574] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:33:55 2022] DELETE /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:33:55.220760 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a702fa56-56d6-45aa-b7c2-69a2fc92e3e4 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:55.221690 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a702fa56-56d6-45aa-b7c2-69a2fc92e3e4 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:55.228836 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a702fa56-56d6-45aa-b7c2-69a2fc92e3e4 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:55.229335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a702fa56-56d6-45aa-b7c2-69a2fc92e3e4 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:55.229783 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a702fa56-56d6-45aa-b7c2-69a2fc92e3e4 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:55.230476 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a702fa56-56d6-45aa-b7c2-69a2fc92e3e4 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:55.231141 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a702fa56-56d6-45aa-b7c2-69a2fc92e3e4 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:55.231772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a702fa56-56d6-45aa-b7c2-69a2fc92e3e4 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:55.367859 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a702fa56-56d6-45aa-b7c2-69a2fc92e3e4 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:55.376484 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a702fa56-56d6-45aa-b7c2-69a2fc92e3e4 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1513 microversion: 2.1 time: 0.160038 Oct 04 03:33:55.377141 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 290/575] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:55 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:33:55.621082 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-79e70efa-27e9-4aa8-a2b5-5aaf79e27e1f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:55.621782 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-79e70efa-27e9-4aa8-a2b5-5aaf79e27e1f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:55.627627 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e70efa-27e9-4aa8-a2b5-5aaf79e27e1f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:55.628111 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e70efa-27e9-4aa8-a2b5-5aaf79e27e1f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:55.628555 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e70efa-27e9-4aa8-a2b5-5aaf79e27e1f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:55.629242 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e70efa-27e9-4aa8-a2b5-5aaf79e27e1f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:55.629697 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e70efa-27e9-4aa8-a2b5-5aaf79e27e1f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:55.630199 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e70efa-27e9-4aa8-a2b5-5aaf79e27e1f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:55.667111 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e70efa-27e9-4aa8-a2b5-5aaf79e27e1f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:55.667577 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e70efa-27e9-4aa8-a2b5-5aaf79e27e1f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:55.668017 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79e70efa-27e9-4aa8-a2b5-5aaf79e27e1f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:55.668457 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-79e70efa-27e9-4aa8-a2b5-5aaf79e27e1f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lazy-loading 'fault' on Instance uuid 6d49bbae-bf97-4c67-a54a-3625acee0ba0 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:33:55.708449 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-79e70efa-27e9-4aa8-a2b5-5aaf79e27e1f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:55.716670 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-79e70efa-27e9-4aa8-a2b5-5aaf79e27e1f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1326 microversion: 2.1 time: 0.100327 Oct 04 03:33:55.717433 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 286/576] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:55 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:56.400954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ee0c1133-c17e-49a9-b7ed-df04952b3475 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:56.401554 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ee0c1133-c17e-49a9-b7ed-df04952b3475 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:56.407971 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ee0c1133-c17e-49a9-b7ed-df04952b3475 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:56.408448 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ee0c1133-c17e-49a9-b7ed-df04952b3475 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:56.408879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ee0c1133-c17e-49a9-b7ed-df04952b3475 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:56.409556 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ee0c1133-c17e-49a9-b7ed-df04952b3475 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:56.410004 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ee0c1133-c17e-49a9-b7ed-df04952b3475 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:56.410422 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ee0c1133-c17e-49a9-b7ed-df04952b3475 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:56.535667 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ee0c1133-c17e-49a9-b7ed-df04952b3475 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:56.544044 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ee0c1133-c17e-49a9-b7ed-df04952b3475 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1513 microversion: 2.1 time: 0.147841 Oct 04 03:33:56.544600 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 291/577] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:56 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:56.740046 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-eedc65c7-8b09-4832-8771-621183b87eb8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:56.740649 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-eedc65c7-8b09-4832-8771-621183b87eb8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:56.747076 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-eedc65c7-8b09-4832-8771-621183b87eb8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:56.747580 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-eedc65c7-8b09-4832-8771-621183b87eb8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:56.748013 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-eedc65c7-8b09-4832-8771-621183b87eb8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:56.748687 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-eedc65c7-8b09-4832-8771-621183b87eb8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:56.749152 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-eedc65c7-8b09-4832-8771-621183b87eb8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:56.749549 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-eedc65c7-8b09-4832-8771-621183b87eb8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:56.780155 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-eedc65c7-8b09-4832-8771-621183b87eb8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:56.780619 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-eedc65c7-8b09-4832-8771-621183b87eb8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:56.781044 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-eedc65c7-8b09-4832-8771-621183b87eb8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:56.781475 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-eedc65c7-8b09-4832-8771-621183b87eb8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lazy-loading 'fault' on Instance uuid 6d49bbae-bf97-4c67-a54a-3625acee0ba0 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:33:56.824015 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-eedc65c7-8b09-4832-8771-621183b87eb8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:56.831589 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-eedc65c7-8b09-4832-8771-621183b87eb8 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1326 microversion: 2.1 time: 0.095428 Oct 04 03:33:56.832161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 287/578] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:56 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1326 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:57.566738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4a4bfca4-c441-41b1-af7d-74009ff4f150 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:57.567343 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4a4bfca4-c441-41b1-af7d-74009ff4f150 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:57.569996 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:57.575523 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a4bfca4-c441-41b1-af7d-74009ff4f150 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:57.575999 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a4bfca4-c441-41b1-af7d-74009ff4f150 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:57.576438 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a4bfca4-c441-41b1-af7d-74009ff4f150 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:57.577121 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a4bfca4-c441-41b1-af7d-74009ff4f150 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:57.577569 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a4bfca4-c441-41b1-af7d-74009ff4f150 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:57.577985 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a4bfca4-c441-41b1-af7d-74009ff4f150 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:57.705090 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-4a4bfca4-c441-41b1-af7d-74009ff4f150 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:57.712949 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4a4bfca4-c441-41b1-af7d-74009ff4f150 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1513 microversion: 2.1 time: 0.150082 Oct 04 03:33:57.713578 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 292/579] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:57 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:57.855398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-bb7acc55-dce4-4180-a01a-149d8b89f317 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:57.856026 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-bb7acc55-dce4-4180-a01a-149d8b89f317 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:57.862341 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bb7acc55-dce4-4180-a01a-149d8b89f317 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:57.862817 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bb7acc55-dce4-4180-a01a-149d8b89f317 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:57.863246 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bb7acc55-dce4-4180-a01a-149d8b89f317 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:57.863959 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bb7acc55-dce4-4180-a01a-149d8b89f317 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:57.864401 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bb7acc55-dce4-4180-a01a-149d8b89f317 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:57.864816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bb7acc55-dce4-4180-a01a-149d8b89f317 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:57.903375 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bb7acc55-dce4-4180-a01a-149d8b89f317 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:57.903886 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bb7acc55-dce4-4180-a01a-149d8b89f317 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:57.904322 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bb7acc55-dce4-4180-a01a-149d8b89f317 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:57.904755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-bb7acc55-dce4-4180-a01a-149d8b89f317 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lazy-loading 'fault' on Instance uuid 6d49bbae-bf97-4c67-a54a-3625acee0ba0 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:33:57.944646 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-bb7acc55-dce4-4180-a01a-149d8b89f317 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:57.952257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-bb7acc55-dce4-4180-a01a-149d8b89f317 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1326 microversion: 2.1 time: 0.101235 Oct 04 03:33:57.952818 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 288/580] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:57 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:58.736185 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-10270818-0e7a-40b6-adea-31d943242941 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:58.736832 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-10270818-0e7a-40b6-adea-31d943242941 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:58.743294 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10270818-0e7a-40b6-adea-31d943242941 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:58.743888 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10270818-0e7a-40b6-adea-31d943242941 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:58.744325 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10270818-0e7a-40b6-adea-31d943242941 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:58.745012 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10270818-0e7a-40b6-adea-31d943242941 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:58.745468 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10270818-0e7a-40b6-adea-31d943242941 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:58.745893 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10270818-0e7a-40b6-adea-31d943242941 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:58.875956 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-10270818-0e7a-40b6-adea-31d943242941 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:58.883741 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-10270818-0e7a-40b6-adea-31d943242941 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1513 microversion: 2.1 time: 0.151253 Oct 04 03:33:58.884313 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 293/581] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:58 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:58.975972 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-91eefe57-4aa9-44b1-ba10-f3469533eb22 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:58.976584 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-91eefe57-4aa9-44b1-ba10-f3469533eb22 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:58.983244 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91eefe57-4aa9-44b1-ba10-f3469533eb22 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:58.983761 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91eefe57-4aa9-44b1-ba10-f3469533eb22 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:58.984203 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91eefe57-4aa9-44b1-ba10-f3469533eb22 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:58.984913 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91eefe57-4aa9-44b1-ba10-f3469533eb22 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:58.985364 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91eefe57-4aa9-44b1-ba10-f3469533eb22 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:58.985787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91eefe57-4aa9-44b1-ba10-f3469533eb22 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:59.015619 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91eefe57-4aa9-44b1-ba10-f3469533eb22 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:59.016090 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91eefe57-4aa9-44b1-ba10-f3469533eb22 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:59.016521 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91eefe57-4aa9-44b1-ba10-f3469533eb22 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:59.016959 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-91eefe57-4aa9-44b1-ba10-f3469533eb22 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lazy-loading 'fault' on Instance uuid 6d49bbae-bf97-4c67-a54a-3625acee0ba0 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:33:59.057031 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-91eefe57-4aa9-44b1-ba10-f3469533eb22 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:33:59.064697 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-91eefe57-4aa9-44b1-ba10-f3469533eb22 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1326 microversion: 2.1 time: 0.092573 Oct 04 03:33:59.065262 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 289/582] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:58 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:33:59.909308 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-123fbc77-f6b1-47f1-96e4-773c29177d6c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:33:59.909925 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-123fbc77-f6b1-47f1-96e4-773c29177d6c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:33:59.917476 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-123fbc77-f6b1-47f1-96e4-773c29177d6c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:59.917960 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-123fbc77-f6b1-47f1-96e4-773c29177d6c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:59.918391 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-123fbc77-f6b1-47f1-96e4-773c29177d6c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:33:59.919137 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-123fbc77-f6b1-47f1-96e4-773c29177d6c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:33:59.919619 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-123fbc77-f6b1-47f1-96e4-773c29177d6c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:33:59.920043 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-123fbc77-f6b1-47f1-96e4-773c29177d6c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:00.051143 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-123fbc77-f6b1-47f1-96e4-773c29177d6c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:00.059478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-123fbc77-f6b1-47f1-96e4-773c29177d6c tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1513 microversion: 2.1 time: 0.154057 Oct 04 03:34:00.060063 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 294/583] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:33:59 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:00.089106 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b998918c-177d-4c6f-8f5e-1df42a0db96e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:00.089722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b998918c-177d-4c6f-8f5e-1df42a0db96e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:00.096490 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b998918c-177d-4c6f-8f5e-1df42a0db96e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:00.096968 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b998918c-177d-4c6f-8f5e-1df42a0db96e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:00.097396 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b998918c-177d-4c6f-8f5e-1df42a0db96e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:00.098086 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b998918c-177d-4c6f-8f5e-1df42a0db96e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:00.098532 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b998918c-177d-4c6f-8f5e-1df42a0db96e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:00.098952 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b998918c-177d-4c6f-8f5e-1df42a0db96e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:00.131538 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b998918c-177d-4c6f-8f5e-1df42a0db96e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:00.132015 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b998918c-177d-4c6f-8f5e-1df42a0db96e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:00.132440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b998918c-177d-4c6f-8f5e-1df42a0db96e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:00.132871 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-b998918c-177d-4c6f-8f5e-1df42a0db96e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lazy-loading 'fault' on Instance uuid 6d49bbae-bf97-4c67-a54a-3625acee0ba0 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:34:00.177031 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b998918c-177d-4c6f-8f5e-1df42a0db96e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:00.185170 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b998918c-177d-4c6f-8f5e-1df42a0db96e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 200 len: 1326 microversion: 2.1 time: 0.100829 Oct 04 03:34:00.185724 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 290/584] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:00 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:00.920718 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-fb143f9a-403b-4fa6-8dc1-29f167612741 req-7f8a2eb4-0776-4ebc-b43d-b3bd1f686f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbd62e87-038e-4701-a33e-81e924d68abd", "name": "network-vif-deleted", "tag": "4e655acc-1939-4263-a840-6575212375cd"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:00.931304 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fb143f9a-403b-4fa6-8dc1-29f167612741 req-7f8a2eb4-0776-4ebc-b43d-b3bd1f686f16 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:00.931896 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fb143f9a-403b-4fa6-8dc1-29f167612741 req-7f8a2eb4-0776-4ebc-b43d-b3bd1f686f16 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:00.932310 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fb143f9a-403b-4fa6-8dc1-29f167612741 req-7f8a2eb4-0776-4ebc-b43d-b3bd1f686f16 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:00.943802 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-fb143f9a-403b-4fa6-8dc1-29f167612741 req-7f8a2eb4-0776-4ebc-b43d-b3bd1f686f16 service nova] Creating event network-vif-deleted:4e655acc-1939-4263-a840-6575212375cd for instance fbd62e87-038e-4701-a33e-81e924d68abd on hv-cinder-84914 Oct 04 03:34:00.949052 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-fb143f9a-403b-4fa6-8dc1-29f167612741 req-7f8a2eb4-0776-4ebc-b43d-b3bd1f686f16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032001 Oct 04 03:34:00.949630 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 295/585] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:01.082827 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-67aa7893-bcba-47e4-99e3-2a32271bfad0 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:01.083430 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-67aa7893-bcba-47e4-99e3-2a32271bfad0 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:01.089925 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67aa7893-bcba-47e4-99e3-2a32271bfad0 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:01.090387 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67aa7893-bcba-47e4-99e3-2a32271bfad0 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:01.090818 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67aa7893-bcba-47e4-99e3-2a32271bfad0 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:01.091528 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67aa7893-bcba-47e4-99e3-2a32271bfad0 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:01.092025 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67aa7893-bcba-47e4-99e3-2a32271bfad0 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:01.092443 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67aa7893-bcba-47e4-99e3-2a32271bfad0 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:01.124806 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67aa7893-bcba-47e4-99e3-2a32271bfad0 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:01.125283 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67aa7893-bcba-47e4-99e3-2a32271bfad0 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:01.125714 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-67aa7893-bcba-47e4-99e3-2a32271bfad0 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:01.126152 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-67aa7893-bcba-47e4-99e3-2a32271bfad0 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lazy-loading 'fault' on Instance uuid fbd62e87-038e-4701-a33e-81e924d68abd {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:34:01.168235 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-67aa7893-bcba-47e4-99e3-2a32271bfad0 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1b67fec65345d3b7973445eab896b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3edbcf8484374dab9697bab576e6afdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:01.175860 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-67aa7893-bcba-47e4-99e3-2a32271bfad0 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 200 len: 1309 microversion: 2.1 time: 0.097644 Oct 04 03:34:01.176423 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 291/586] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:01 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:01.208400 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1fc0a44c-6b36-416a-98e2-abacad3a759b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:01.209184 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1fc0a44c-6b36-416a-98e2-abacad3a759b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:01.215886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1fc0a44c-6b36-416a-98e2-abacad3a759b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:01.216377 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1fc0a44c-6b36-416a-98e2-abacad3a759b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:01.216824 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1fc0a44c-6b36-416a-98e2-abacad3a759b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:01.217517 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1fc0a44c-6b36-416a-98e2-abacad3a759b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:01.217973 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1fc0a44c-6b36-416a-98e2-abacad3a759b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:01.218398 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1fc0a44c-6b36-416a-98e2-abacad3a759b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:01.235470 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-1fc0a44c-6b36-416a-98e2-abacad3a759b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] HTTP exception thrown: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1fc0a44c-6b36-416a-98e2-abacad3a759b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Request method failure captured: Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 HTTP/1.1 Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6imTXpCFrfUtRr6Xl2jNi1ZkpVTc3kROqki-pexiEhBj3pdcindQ8ak2ZcMuhhp30dP0KcmE79kyPP3QLyOem4LF07BrLklMBMjd3Ugc13skmHkONTHdGbuQe-_v4MEDkV9mT6BGvnTI-oPibdTunwxfCPkGeEG3FdFlsinpbdzhpE Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: 2011dec80f764558a3a0fe210cdd0755 Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:34:01.237198 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:34:01.238799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2011dec80f764558a3a0fe210cdd0755"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2011dec80f764558a3a0fe210cdd0755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2011dec80f764558a3a0fe210cdd0755", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2011dec80f764558a3a0fe210cdd0755"}]}] Oct 04 03:34:01.238799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:34:01.238799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: 2011dec80f764558a3a0fe210cdd0755 Oct 04 03:34:01.238799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:34:01.238799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-AttachVolumeTestJSON-2041044916-project Oct 04 03:34:01.238799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:34:01.238799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:34:01.238799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: 02f76bc3ab354c4a8e9941e1403274ae Oct 04 03:34:01.238799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeTestJSON-2041044916-project Oct 04 03:34:01.238799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:34:01.238799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:34:01.238799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '6d49bbae-bf97-4c67-a54a-3625acee0ba0'} Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:34:01.239766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:34:01.241216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:01.242645 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1fc0a44c-6b36-416a-98e2-abacad3a759b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Returning 404 to user: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:34:01.242645 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1fc0a44c-6b36-416a-98e2-abacad3a759b tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 404 len: 111 microversion: 2.1 time: 0.034491 Oct 04 03:34:01.242645 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 296/587] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:01 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:34:01.248294 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0d214345-fe3f-4e6a-a0e2-d53033801254 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '.version_select at 0x7f165b4199d0>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:01.266410 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0d214345-fe3f-4e6a-a0e2-d53033801254 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101053467" status: 202 len: 0 microversion: 2.1 time: 0.022111 Oct 04 03:34:01.266966 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 292/588] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Oct 4 03:34:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101053467 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:34:01.897025 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4f9ade8a-97e8-4d07-9bee-395717c27070 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Action: 'create', calling method: .version_select at 0x7f165b3bb160>, body: {"keypair": {"name": "tempest-keypair-1517059178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMy3PigKiifiiaqZ2AM1dX4seqsSJu8SfwFL3/yKqlgIur8HcX2BNlXoN2BkS3ZjnCVhjIn3qnDzojJc/AV/CoqKAgGwmB8mYWLGv3MGei8uGQGPp3sBCXR91x+hk4FjSg=="}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:01.922345 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-4f9ade8a-97e8-4d07-9bee-395717c27070 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Getting quotas for project 2011dec80f764558a3a0fe210cdd0755. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:34:01.926155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-4f9ade8a-97e8-4d07-9bee-395717c27070 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Getting quotas for user 02f76bc3ab354c4a8e9941e1403274ae and project 2011dec80f764558a3a0fe210cdd0755. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:34:01.950471 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4f9ade8a-97e8-4d07-9bee-395717c27070 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060088 Oct 04 03:34:01.951058 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 297/589] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Oct 4 03:34:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:02.201618 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-55500eb1-05f5-496f-84e6-f8080bc31aa6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:02.202240 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-55500eb1-05f5-496f-84e6-f8080bc31aa6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] [instance: fbd62e87-038e-4701-a33e-81e924d68abd] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:02.208906 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-55500eb1-05f5-496f-84e6-f8080bc31aa6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:02.209397 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-55500eb1-05f5-496f-84e6-f8080bc31aa6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:02.210025 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-55500eb1-05f5-496f-84e6-f8080bc31aa6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:02.210727 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-55500eb1-05f5-496f-84e6-f8080bc31aa6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:02.211179 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-55500eb1-05f5-496f-84e6-f8080bc31aa6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:02.211844 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-55500eb1-05f5-496f-84e6-f8080bc31aa6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:02.228443 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-55500eb1-05f5-496f-84e6-f8080bc31aa6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] HTTP exception thrown: Instance fbd62e87-038e-4701-a33e-81e924d68abd could not be found. Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-55500eb1-05f5-496f-84e6-f8080bc31aa6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Request method failure captured: Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd HTTP/1.1 Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6kpxXMJUFZ-lQQqomt5XJ6YLolAnOn2o7U2SVDM-q9puJWC2FTJMzbRHBkro9NS_dAbqng1pd_rnQIwRGgU0glNUh135EpweIZFebAwy5Qsr35GU0iU5GC5ZkcG2X_Jh7xL5JlDJMEF-y61aj_x5ejPYD0iSaBI6XIqqtDVwPc8XEs Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 3edbcf8484374dab9697bab576e6afdb Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-VolumesSnapshotTestJSON-605500478 Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:34:02.230295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:34:02.231756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3edbcf8484374dab9697bab576e6afdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3edbcf8484374dab9697bab576e6afdb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3edbcf8484374dab9697bab576e6afdb", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3edbcf8484374dab9697bab576e6afdb"}]}] Oct 04 03:34:02.231756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-VolumesSnapshotTestJSON-605500478 Oct 04 03:34:02.231756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 3edbcf8484374dab9697bab576e6afdb Oct 04 03:34:02.231756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-605500478 Oct 04 03:34:02.231756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-VolumesSnapshotTestJSON-605500478-project Oct 04 03:34:02.231756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:34:02.231756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:34:02.231756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 4d1b67fec65345d3b7973445eab896b2 Oct 04 03:34:02.231756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-VolumesSnapshotTestJSON-605500478-project Oct 04 03:34:02.231756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:34:02.231756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance fbd62e87-038e-4701-a33e-81e924d68abd could not be found. Oct 04 03:34:02.231756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': 'fbd62e87-038e-4701-a33e-81e924d68abd'} Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbd62e87-038e-4701-a33e-81e924d68abd could not be found. Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:34:02.232659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbd62e87-038e-4701-a33e-81e924d68abd could not be found. Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbd62e87-038e-4701-a33e-81e924d68abd could not be found. Oct 04 03:34:02.233996 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:02.236767 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-55500eb1-05f5-496f-84e6-f8080bc31aa6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] Returning 404 to user: Instance fbd62e87-038e-4701-a33e-81e924d68abd could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:34:02.236767 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-55500eb1-05f5-496f-84e6-f8080bc31aa6 tempest-VolumesSnapshotTestJSON-605500478 tempest-VolumesSnapshotTestJSON-605500478-project] 10.222.0.25 "GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd" status: 404 len: 111 microversion: 2.1 time: 0.035083 Oct 04 03:34:02.238275 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 293/590] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:02 2022] GET /compute/v2.1/servers/fbd62e87-038e-4701-a33e-81e924d68abd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:34:03.250662 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-119250208", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5746e31-b69a-42a2-90cf-dfad137d2069"}], "security_groups": [{"name": "tempest-securitygroup--1823055178"}], "key_name": "tempest-keypair-1517059178", "user_data": "}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:03.360862 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] validate_networks() for [('c5746e31-b69a-42a2-90cf-dfad137d2069', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:34:03.765778 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:34:03.766193 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:34:03.766657 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:34:03.767057 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:34:03.767459 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:34:03.776121 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:03.776596 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:03.777022 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:03.777737 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:03.778186 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:03.778601 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:03.795245 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Getting quotas for project 2011dec80f764558a3a0fe210cdd0755. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:34:03.799216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Getting quotas for user 02f76bc3ab354c4a8e9941e1403274ae and project 2011dec80f764558a3a0fe210cdd0755. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:34:03.810737 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:34:03.813039 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:34:03.860818 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-edd84265-bed2-4ff5-999a-93c21f2a4ae6 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.614811 Oct 04 03:34:03.862676 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 298/591] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:34:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 03:34:03.873537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-89879937-7c9d-4e28-8e51-9c437aad389f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:03.874168 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-89879937-7c9d-4e28-8e51-9c437aad389f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:03.932442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-89879937-7c9d-4e28-8e51-9c437aad389f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:03.939180 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-89879937-7c9d-4e28-8e51-9c437aad389f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1237 microversion: 2.1 time: 0.069500 Oct 04 03:34:03.939793 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 294/592] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:03 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:34:04.963347 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f0de4ac6-87ce-46d6-abf2-e4e2bcff1086 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:04.964061 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f0de4ac6-87ce-46d6-abf2-e4e2bcff1086 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:04.971811 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f0de4ac6-87ce-46d6-abf2-e4e2bcff1086 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:04.972666 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f0de4ac6-87ce-46d6-abf2-e4e2bcff1086 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:04.973427 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f0de4ac6-87ce-46d6-abf2-e4e2bcff1086 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:04.974404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f0de4ac6-87ce-46d6-abf2-e4e2bcff1086 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:04.975124 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f0de4ac6-87ce-46d6-abf2-e4e2bcff1086 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:04.975770 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f0de4ac6-87ce-46d6-abf2-e4e2bcff1086 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:05.096050 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f0de4ac6-87ce-46d6-abf2-e4e2bcff1086 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:05.110708 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f0de4ac6-87ce-46d6-abf2-e4e2bcff1086 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1297 microversion: 2.1 time: 0.149069 Oct 04 03:34:05.123821 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 299/593] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:04 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1297 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:06.138538 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-86a45201-583e-401e-b654-c3ef8ee45f00 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:06.139179 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-86a45201-583e-401e-b654-c3ef8ee45f00 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:06.146545 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-86a45201-583e-401e-b654-c3ef8ee45f00 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:06.147040 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-86a45201-583e-401e-b654-c3ef8ee45f00 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:06.147502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-86a45201-583e-401e-b654-c3ef8ee45f00 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:06.148322 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-86a45201-583e-401e-b654-c3ef8ee45f00 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:06.148967 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-86a45201-583e-401e-b654-c3ef8ee45f00 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:06.150030 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-86a45201-583e-401e-b654-c3ef8ee45f00 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:06.349547 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-86a45201-583e-401e-b654-c3ef8ee45f00 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:06.358919 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-86a45201-583e-401e-b654-c3ef8ee45f00 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1363 microversion: 2.1 time: 0.224234 Oct 04 03:34:06.359852 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 295/594] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:06 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:06.482393 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-b40d66fa-8b45-44f3-9ac9-92f29dfc02b4 req-ec40b508-df2d-44b1-a0df-06468284bccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88de3151-74fc-49a6-9577-148cf0835d88", "tag": "a993f04e-64f4-4fca-8b84-86ea7fef05bc"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:06.510085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b40d66fa-8b45-44f3-9ac9-92f29dfc02b4 req-ec40b508-df2d-44b1-a0df-06468284bccf service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:06.510769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b40d66fa-8b45-44f3-9ac9-92f29dfc02b4 req-ec40b508-df2d-44b1-a0df-06468284bccf service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:06.511438 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b40d66fa-8b45-44f3-9ac9-92f29dfc02b4 req-ec40b508-df2d-44b1-a0df-06468284bccf service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:06.523349 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-b40d66fa-8b45-44f3-9ac9-92f29dfc02b4 req-ec40b508-df2d-44b1-a0df-06468284bccf service nova] Creating event network-changed:a993f04e-64f4-4fca-8b84-86ea7fef05bc for instance 88de3151-74fc-49a6-9577-148cf0835d88 on hv-cinder-84914 Oct 04 03:34:06.529029 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-b40d66fa-8b45-44f3-9ac9-92f29dfc02b4 req-ec40b508-df2d-44b1-a0df-06468284bccf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051226 Oct 04 03:34:06.529677 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 300/595] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:07.383965 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-8329fb4f-75fd-489a-8f6c-76e11cd690e0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:07.384570 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-8329fb4f-75fd-489a-8f6c-76e11cd690e0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:07.390869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8329fb4f-75fd-489a-8f6c-76e11cd690e0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:07.391343 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8329fb4f-75fd-489a-8f6c-76e11cd690e0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:07.391809 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8329fb4f-75fd-489a-8f6c-76e11cd690e0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:07.392485 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8329fb4f-75fd-489a-8f6c-76e11cd690e0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:07.392927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8329fb4f-75fd-489a-8f6c-76e11cd690e0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:07.393340 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8329fb4f-75fd-489a-8f6c-76e11cd690e0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:07.524205 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-8329fb4f-75fd-489a-8f6c-76e11cd690e0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:07.531777 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-8329fb4f-75fd-489a-8f6c-76e11cd690e0 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1363 microversion: 2.1 time: 0.152311 Oct 04 03:34:07.532345 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 296/596] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:07 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:08.556373 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-813d34b1-7519-44d9-a96f-06351feb8dba tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:08.556999 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-813d34b1-7519-44d9-a96f-06351feb8dba tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:08.563776 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-813d34b1-7519-44d9-a96f-06351feb8dba tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:08.564265 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-813d34b1-7519-44d9-a96f-06351feb8dba tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:08.564698 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-813d34b1-7519-44d9-a96f-06351feb8dba tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:08.565394 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-813d34b1-7519-44d9-a96f-06351feb8dba tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:08.565849 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-813d34b1-7519-44d9-a96f-06351feb8dba tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:08.566267 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-813d34b1-7519-44d9-a96f-06351feb8dba tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:08.697032 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-813d34b1-7519-44d9-a96f-06351feb8dba tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:08.704602 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-813d34b1-7519-44d9-a96f-06351feb8dba tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1363 microversion: 2.1 time: 0.152858 Oct 04 03:34:08.705169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 301/597] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:08 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:09.727910 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-641934db-d7c3-4f73-8e23-809b8809306e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:09.728550 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-641934db-d7c3-4f73-8e23-809b8809306e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:09.731019 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:09.736287 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-641934db-d7c3-4f73-8e23-809b8809306e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:09.736770 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-641934db-d7c3-4f73-8e23-809b8809306e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:09.737206 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-641934db-d7c3-4f73-8e23-809b8809306e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:09.737888 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-641934db-d7c3-4f73-8e23-809b8809306e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:09.738338 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-641934db-d7c3-4f73-8e23-809b8809306e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:09.738757 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-641934db-d7c3-4f73-8e23-809b8809306e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:09.871344 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-641934db-d7c3-4f73-8e23-809b8809306e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:09.880475 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-641934db-d7c3-4f73-8e23-809b8809306e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1363 microversion: 2.1 time: 0.156419 Oct 04 03:34:09.881049 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 297/598] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:09 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:10.905007 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cf708b5f-1135-42d0-a733-86450e2148a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:10.905540 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cf708b5f-1135-42d0-a733-86450e2148a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:10.912199 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cf708b5f-1135-42d0-a733-86450e2148a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:10.912744 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cf708b5f-1135-42d0-a733-86450e2148a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:10.913176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cf708b5f-1135-42d0-a733-86450e2148a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:10.913862 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cf708b5f-1135-42d0-a733-86450e2148a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:10.914345 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cf708b5f-1135-42d0-a733-86450e2148a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:10.914771 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cf708b5f-1135-42d0-a733-86450e2148a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:11.043356 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-cf708b5f-1135-42d0-a733-86450e2148a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:11.050859 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cf708b5f-1135-42d0-a733-86450e2148a5 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1363 microversion: 2.1 time: 0.149832 Oct 04 03:34:11.051416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 302/599] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:10 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:12.074683 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-52f11da6-bfcc-4e04-b8e3-bce8301cd665 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:12.075288 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-52f11da6-bfcc-4e04-b8e3-bce8301cd665 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:12.081852 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-52f11da6-bfcc-4e04-b8e3-bce8301cd665 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:12.082329 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-52f11da6-bfcc-4e04-b8e3-bce8301cd665 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:12.082757 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-52f11da6-bfcc-4e04-b8e3-bce8301cd665 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:12.083442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-52f11da6-bfcc-4e04-b8e3-bce8301cd665 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:12.083908 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-52f11da6-bfcc-4e04-b8e3-bce8301cd665 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:12.084324 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-52f11da6-bfcc-4e04-b8e3-bce8301cd665 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:12.210057 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-52f11da6-bfcc-4e04-b8e3-bce8301cd665 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:12.218251 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-52f11da6-bfcc-4e04-b8e3-bce8301cd665 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1363 microversion: 2.1 time: 0.147927 Oct 04 03:34:12.218825 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 298/600] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:12 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:12.390812 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-d912b1eb-1cf4-4c4c-ab37-7b1887fdee33 req-19cac263-f280-4ca3-ad28-ce88ef9bbf80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88de3151-74fc-49a6-9577-148cf0835d88", "name": "network-vif-plugged", "status": "completed", "tag": "a993f04e-64f4-4fca-8b84-86ea7fef05bc"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:12.401428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d912b1eb-1cf4-4c4c-ab37-7b1887fdee33 req-19cac263-f280-4ca3-ad28-ce88ef9bbf80 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:12.401913 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d912b1eb-1cf4-4c4c-ab37-7b1887fdee33 req-19cac263-f280-4ca3-ad28-ce88ef9bbf80 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:12.402352 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d912b1eb-1cf4-4c4c-ab37-7b1887fdee33 req-19cac263-f280-4ca3-ad28-ce88ef9bbf80 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:12.413444 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-d912b1eb-1cf4-4c4c-ab37-7b1887fdee33 req-19cac263-f280-4ca3-ad28-ce88ef9bbf80 service nova] Creating event network-vif-plugged:a993f04e-64f4-4fca-8b84-86ea7fef05bc for instance 88de3151-74fc-49a6-9577-148cf0835d88 on hv-cinder-84914 Oct 04 03:34:12.418866 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-d912b1eb-1cf4-4c4c-ab37-7b1887fdee33 req-19cac263-f280-4ca3-ad28-ce88ef9bbf80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032035 Oct 04 03:34:12.419450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 303/601] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:13.241780 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c816a8dd-e73a-484e-b695-acddbe21aafd tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:13.242381 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c816a8dd-e73a-484e-b695-acddbe21aafd tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:13.249100 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c816a8dd-e73a-484e-b695-acddbe21aafd tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:13.249577 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c816a8dd-e73a-484e-b695-acddbe21aafd tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:13.250009 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c816a8dd-e73a-484e-b695-acddbe21aafd tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:13.250694 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c816a8dd-e73a-484e-b695-acddbe21aafd tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:13.251168 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c816a8dd-e73a-484e-b695-acddbe21aafd tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:13.251626 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c816a8dd-e73a-484e-b695-acddbe21aafd tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:13.379023 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c816a8dd-e73a-484e-b695-acddbe21aafd tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:13.387240 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c816a8dd-e73a-484e-b695-acddbe21aafd tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1363 microversion: 2.1 time: 0.149296 Oct 04 03:34:13.388183 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 299/602] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:13 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:14.407796 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:14.408474 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=10 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:14.412568 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c3b1e872-f3dc-4b53-99fb-ce4747511026 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:14.413308 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c3b1e872-f3dc-4b53-99fb-ce4747511026 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:14.421021 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c3b1e872-f3dc-4b53-99fb-ce4747511026 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:14.421499 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c3b1e872-f3dc-4b53-99fb-ce4747511026 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:14.421927 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c3b1e872-f3dc-4b53-99fb-ce4747511026 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:14.422609 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c3b1e872-f3dc-4b53-99fb-ce4747511026 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:14.423052 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c3b1e872-f3dc-4b53-99fb-ce4747511026 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:14.423469 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c3b1e872-f3dc-4b53-99fb-ce4747511026 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:14.554759 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c3b1e872-f3dc-4b53-99fb-ce4747511026 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:14.562491 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c3b1e872-f3dc-4b53-99fb-ce4747511026 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1363 microversion: 2.1 time: 0.156190 Oct 04 03:34:14.563054 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 304/603] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:14 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:15.586144 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2808cb0b-ba71-4e19-ba64-094dff6b12cf tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:15.587142 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-2808cb0b-ba71-4e19-ba64-094dff6b12cf tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:15.589189 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:15.595232 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2808cb0b-ba71-4e19-ba64-094dff6b12cf tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:15.595759 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2808cb0b-ba71-4e19-ba64-094dff6b12cf tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:15.596199 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2808cb0b-ba71-4e19-ba64-094dff6b12cf tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:15.596888 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2808cb0b-ba71-4e19-ba64-094dff6b12cf tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:15.597340 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2808cb0b-ba71-4e19-ba64-094dff6b12cf tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:15.598093 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2808cb0b-ba71-4e19-ba64-094dff6b12cf tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:15.732214 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-2808cb0b-ba71-4e19-ba64-094dff6b12cf tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:15.739799 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2808cb0b-ba71-4e19-ba64-094dff6b12cf tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1550 microversion: 2.1 time: 0.157566 Oct 04 03:34:15.740365 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 300/604] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:15 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:15.762571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c1cbf9b9-0cee-4739-ac1f-7bc6ec85490e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:15.763075 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c1cbf9b9-0cee-4739-ac1f-7bc6ec85490e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:15.769572 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c1cbf9b9-0cee-4739-ac1f-7bc6ec85490e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:15.770051 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c1cbf9b9-0cee-4739-ac1f-7bc6ec85490e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:15.770476 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c1cbf9b9-0cee-4739-ac1f-7bc6ec85490e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:15.771155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c1cbf9b9-0cee-4739-ac1f-7bc6ec85490e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:15.771626 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c1cbf9b9-0cee-4739-ac1f-7bc6ec85490e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:15.772044 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c1cbf9b9-0cee-4739-ac1f-7bc6ec85490e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:15.852518 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c1cbf9b9-0cee-4739-ac1f-7bc6ec85490e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094344 Oct 04 03:34:15.853204 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 305/605] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Oct 4 03:34:15 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:15.899172 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-541eedfc-384f-4283-8c2a-99442d6f8a4f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:15.899748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-541eedfc-384f-4283-8c2a-99442d6f8a4f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:15.905703 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-541eedfc-384f-4283-8c2a-99442d6f8a4f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:15.906186 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-541eedfc-384f-4283-8c2a-99442d6f8a4f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:15.906620 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-541eedfc-384f-4283-8c2a-99442d6f8a4f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:15.907310 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-541eedfc-384f-4283-8c2a-99442d6f8a4f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:15.907884 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-541eedfc-384f-4283-8c2a-99442d6f8a4f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:15.908209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-541eedfc-384f-4283-8c2a-99442d6f8a4f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:15.931687 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-541eedfc-384f-4283-8c2a-99442d6f8a4f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/ips" status: 200 len: 150 microversion: 2.1 time: 0.036035 Oct 04 03:34:15.932261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 301/606] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Oct 4 03:34:15 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:16.812229 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-5c78f610-abfa-4362-9724-35bc5af00d4e req-d5f655b6-dc5b-4df9-89ca-497e247db055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88de3151-74fc-49a6-9577-148cf0835d88", "tag": "a993f04e-64f4-4fca-8b84-86ea7fef05bc"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:16.822302 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-5c78f610-abfa-4362-9724-35bc5af00d4e req-d5f655b6-dc5b-4df9-89ca-497e247db055 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:16.823033 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-5c78f610-abfa-4362-9724-35bc5af00d4e req-d5f655b6-dc5b-4df9-89ca-497e247db055 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:16.823587 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-5c78f610-abfa-4362-9724-35bc5af00d4e req-d5f655b6-dc5b-4df9-89ca-497e247db055 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:16.834634 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-5c78f610-abfa-4362-9724-35bc5af00d4e req-d5f655b6-dc5b-4df9-89ca-497e247db055 service nova] Creating event network-changed:a993f04e-64f4-4fca-8b84-86ea7fef05bc for instance 88de3151-74fc-49a6-9577-148cf0835d88 on hv-cinder-84914 Oct 04 03:34:16.840413 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-5c78f610-abfa-4362-9724-35bc5af00d4e req-d5f655b6-dc5b-4df9-89ca-497e247db055 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032193 Oct 04 03:34:16.841006 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 306/607] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:17.333040 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-91f7a541-cd33-48c7-8bfa-7806e5f23396 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7586180-7ca0-4952-8b58-feb4d1abcea6"}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:17.336067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-91f7a541-cd33-48c7-8bfa-7806e5f23396 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:17.343783 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91f7a541-cd33-48c7-8bfa-7806e5f23396 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:17.344476 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91f7a541-cd33-48c7-8bfa-7806e5f23396 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:17.345091 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91f7a541-cd33-48c7-8bfa-7806e5f23396 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:17.345932 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91f7a541-cd33-48c7-8bfa-7806e5f23396 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:17.346527 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91f7a541-cd33-48c7-8bfa-7806e5f23396 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:17.347093 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91f7a541-cd33-48c7-8bfa-7806e5f23396 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:17.364427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:17.635473 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-91f7a541-cd33-48c7-8bfa-7806e5f23396 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "POST /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307433 Oct 04 03:34:17.636222 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 302/608] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Oct 4 03:34:17 2022] POST /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:34:17.968027 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8b73e51f-76c5-48dd-a22c-75f7bc49ca38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:17.968577 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8b73e51f-76c5-48dd-a22c-75f7bc49ca38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:17.975310 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b73e51f-76c5-48dd-a22c-75f7bc49ca38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:17.975815 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b73e51f-76c5-48dd-a22c-75f7bc49ca38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:17.976253 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b73e51f-76c5-48dd-a22c-75f7bc49ca38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:17.976940 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b73e51f-76c5-48dd-a22c-75f7bc49ca38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:17.977382 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b73e51f-76c5-48dd-a22c-75f7bc49ca38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:17.977846 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b73e51f-76c5-48dd-a22c-75f7bc49ca38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:18.062102 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-8b73e51f-76c5-48dd-a22c-75f7bc49ca38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lazy-loading 'services' on Instance uuid 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:34:18.133240 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8b73e51f-76c5-48dd-a22c-75f7bc49ca38 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "DELETE /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-volume_attachments/34bd1673-8f25-4cf5-b752-6afd1f280af5" status: 202 len: 0 microversion: 2.1 time: 0.169468 Oct 04 03:34:18.133814 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 307/609] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Oct 4 03:34:17 2022] DELETE /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-volume_attachments/34bd1673-8f25-4cf5-b752-6afd1f280af5 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:34:18.143579 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-bd4714ec-32e2-48f8-ab1a-80f074a6185c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:18.145910 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-bd4714ec-32e2-48f8-ab1a-80f074a6185c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:18.152541 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bd4714ec-32e2-48f8-ab1a-80f074a6185c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:18.152958 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bd4714ec-32e2-48f8-ab1a-80f074a6185c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:18.153394 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bd4714ec-32e2-48f8-ab1a-80f074a6185c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:18.154113 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bd4714ec-32e2-48f8-ab1a-80f074a6185c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:18.154561 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bd4714ec-32e2-48f8-ab1a-80f074a6185c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:18.155013 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bd4714ec-32e2-48f8-ab1a-80f074a6185c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:18.185370 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-bd4714ec-32e2-48f8-ab1a-80f074a6185c tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046442 Oct 04 03:34:18.185921 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 303/610] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:34:18 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:19.201666 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-35fc65a8-2e63-436a-95ea-e9437e230ebd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:19.204165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-35fc65a8-2e63-436a-95ea-e9437e230ebd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:19.210460 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35fc65a8-2e63-436a-95ea-e9437e230ebd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:19.210933 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35fc65a8-2e63-436a-95ea-e9437e230ebd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:19.211358 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35fc65a8-2e63-436a-95ea-e9437e230ebd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:19.212097 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35fc65a8-2e63-436a-95ea-e9437e230ebd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:19.212542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35fc65a8-2e63-436a-95ea-e9437e230ebd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:19.212952 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35fc65a8-2e63-436a-95ea-e9437e230ebd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:19.245205 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-35fc65a8-2e63-436a-95ea-e9437e230ebd tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051385 Oct 04 03:34:19.245944 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 308/611] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:34:19 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:19.892849 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-93a5c8df-3fdd-4a2f-a8d8-f6a62fa13a34 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7586180-7ca0-4952-8b58-feb4d1abcea6"}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:19.895796 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-93a5c8df-3fdd-4a2f-a8d8-f6a62fa13a34 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:19.902995 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-93a5c8df-3fdd-4a2f-a8d8-f6a62fa13a34 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:19.903469 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-93a5c8df-3fdd-4a2f-a8d8-f6a62fa13a34 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:19.903926 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-93a5c8df-3fdd-4a2f-a8d8-f6a62fa13a34 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:19.904613 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-93a5c8df-3fdd-4a2f-a8d8-f6a62fa13a34 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:19.905056 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-93a5c8df-3fdd-4a2f-a8d8-f6a62fa13a34 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:19.905469 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-93a5c8df-3fdd-4a2f-a8d8-f6a62fa13a34 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:19.985941 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-93a5c8df-3fdd-4a2f-a8d8-f6a62fa13a34 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] HTTP exception thrown: Invalid volume: volume d7586180-7ca0-4952-8b58-feb4d1abcea6 is already attached to instances: fa285589-057b-4a56-9da5-614e561bb64b Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-93a5c8df-3fdd-4a2f-a8d8-f6a62fa13a34 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Request method failure captured: Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: POST /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments HTTP/1.1 Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 74 Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6isUYhgYsAb2pqxJ5i2_6gzGtKyJzLe2quMbLKiFrXtrxQIhaAv2XwsUqEAkN7Fh1WqlIXaqgH_JRfN3W7XWKG2TyqZRi_OBW_0jILA2kaoQ2SSAvWUeuuoQxbaW7Q90VlSmfhWYx2fgtTX4JS2Hb0X2tvDyvvlYbTndLm_mtGSa4s Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:34:19.987787 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:34:19.989361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d6ee89cb464afa95e222b2a1e7279b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d6ee89cb464afa95e222b2a1e7279b"}]}] Oct 04 03:34:19.989361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:34:19.989361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:34:19.989361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:34:19.989361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:34:19.989361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:34:19.989361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:34:19.989361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: b8795829c34046628cae345dd4d45e75 Oct 04 03:34:19.989361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:34:19.989361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Oct 04 03:34:19.989361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {"volumeAttachment": {"volumeId": "d7586180-7ca0-4952-8b58-feb4d1abcea6"}} Oct 04 03:34:19.989361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Invalid volume: volume d7586180-7ca0-4952-8b58-feb4d1abcea6 is already attached to instances: fa285589-057b-4a56-9da5-614e561bb64b Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'server_id': 'fa285589-057b-4a56-9da5-614e561bb64b', 'body': {'volumeAttachment': {'volumeId': 'd7586180-7ca0-4952-8b58-feb4d1abcea6'}}} Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d7586180-7ca0-4952-8b58-feb4d1abcea6 is already attached to instances: fa285589-057b-4a56-9da5-614e561bb64b Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:19.990233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d7586180-7ca0-4952-8b58-feb4d1abcea6 is already attached to instances: fa285589-057b-4a56-9da5-614e561bb64b Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:19.991690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:19.994556 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:19.994556 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:34:19.994556 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:34:19.994556 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d7586180-7ca0-4952-8b58-feb4d1abcea6 is already attached to instances: fa285589-057b-4a56-9da5-614e561bb64b Oct 04 03:34:19.994556 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:19.994556 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-93a5c8df-3fdd-4a2f-a8d8-f6a62fa13a34 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Returning 400 to user: Invalid volume: volume d7586180-7ca0-4952-8b58-feb4d1abcea6 is already attached to instances: fa285589-057b-4a56-9da5-614e561bb64b {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:34:19.994556 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-93a5c8df-3fdd-4a2f-a8d8-f6a62fa13a34 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "POST /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100731 Oct 04 03:34:19.994556 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 304/612] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Oct 4 03:34:19 2022] POST /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 03:34:20.058968 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8ec836d8-abe2-45e6-92b0-95e2fc38000a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:20.059460 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8ec836d8-abe2-45e6-92b0-95e2fc38000a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:20.066251 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8ec836d8-abe2-45e6-92b0-95e2fc38000a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:20.066733 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8ec836d8-abe2-45e6-92b0-95e2fc38000a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:20.067170 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8ec836d8-abe2-45e6-92b0-95e2fc38000a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:20.067891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8ec836d8-abe2-45e6-92b0-95e2fc38000a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:20.068335 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8ec836d8-abe2-45e6-92b0-95e2fc38000a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:20.069740 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8ec836d8-abe2-45e6-92b0-95e2fc38000a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:20.074687 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:20.161305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-8ec836d8-abe2-45e6-92b0-95e2fc38000a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lazy-loading 'services' on Instance uuid fa285589-057b-4a56-9da5-614e561bb64b {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:34:20.238213 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8ec836d8-abe2-45e6-92b0-95e2fc38000a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments/d7586180-7ca0-4952-8b58-feb4d1abcea6" status: 202 len: 0 microversion: 2.1 time: 0.183322 Oct 04 03:34:20.238886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 309/613] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Oct 4 03:34:20 2022] DELETE /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments/d7586180-7ca0-4952-8b58-feb4d1abcea6 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:34:20.248351 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9c048952-58b2-497e-82a9-c778bb462acb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:20.250634 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-9c048952-58b2-497e-82a9-c778bb462acb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:20.258381 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c048952-58b2-497e-82a9-c778bb462acb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:20.259113 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c048952-58b2-497e-82a9-c778bb462acb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:20.259963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c048952-58b2-497e-82a9-c778bb462acb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:20.260665 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c048952-58b2-497e-82a9-c778bb462acb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:20.261284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c048952-58b2-497e-82a9-c778bb462acb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:20.261882 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c048952-58b2-497e-82a9-c778bb462acb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:20.264057 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d715aa10-5d4c-4308-a939-83e59e93a885 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:20.266420 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d715aa10-5d4c-4308-a939-83e59e93a885 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:20.273764 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d715aa10-5d4c-4308-a939-83e59e93a885 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:20.274495 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d715aa10-5d4c-4308-a939-83e59e93a885 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:20.275175 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d715aa10-5d4c-4308-a939-83e59e93a885 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:20.276251 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d715aa10-5d4c-4308-a939-83e59e93a885 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:20.276844 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d715aa10-5d4c-4308-a939-83e59e93a885 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:20.277416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d715aa10-5d4c-4308-a939-83e59e93a885 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:20.296367 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-9c048952-58b2-497e-82a9-c778bb462acb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052682 Oct 04 03:34:20.301876 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 305/614] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:34:20 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:20.316326 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d715aa10-5d4c-4308-a939-83e59e93a885 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059164 Oct 04 03:34:20.322526 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 310/615] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:34:20 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 03:34:20.397278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-5e839a49-b6ef-44e5-ad4e-46bcd9a731bf tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:20.397790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-5e839a49-b6ef-44e5-ad4e-46bcd9a731bf tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:20.404222 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5e839a49-b6ef-44e5-ad4e-46bcd9a731bf tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:20.404715 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5e839a49-b6ef-44e5-ad4e-46bcd9a731bf tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:20.405141 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5e839a49-b6ef-44e5-ad4e-46bcd9a731bf tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:20.405828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5e839a49-b6ef-44e5-ad4e-46bcd9a731bf tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:20.406276 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5e839a49-b6ef-44e5-ad4e-46bcd9a731bf tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:20.406694 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5e839a49-b6ef-44e5-ad4e-46bcd9a731bf tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:20.434137 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-5e839a49-b6ef-44e5-ad4e-46bcd9a731bf tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Going to try to terminate instance {{(pid=120595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:34:20.521290 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-5e839a49-b6ef-44e5-ad4e-46bcd9a731bf tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "DELETE /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 204 len: 0 microversion: 2.1 time: 0.127717 Oct 04 03:34:20.522169 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 306/616] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:34:20 2022] DELETE /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:34:20.530651 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f10a2fa1-bb7c-46b1-9d34-457e7bfc1256 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:20.531454 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f10a2fa1-bb7c-46b1-9d34-457e7bfc1256 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:20.537454 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f10a2fa1-bb7c-46b1-9d34-457e7bfc1256 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:20.538042 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f10a2fa1-bb7c-46b1-9d34-457e7bfc1256 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:20.538537 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f10a2fa1-bb7c-46b1-9d34-457e7bfc1256 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:20.539309 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f10a2fa1-bb7c-46b1-9d34-457e7bfc1256 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:20.539863 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f10a2fa1-bb7c-46b1-9d34-457e7bfc1256 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:20.540440 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f10a2fa1-bb7c-46b1-9d34-457e7bfc1256 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:20.692102 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f10a2fa1-bb7c-46b1-9d34-457e7bfc1256 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:20.701355 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f10a2fa1-bb7c-46b1-9d34-457e7bfc1256 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1691 microversion: 2.1 time: 0.173940 Oct 04 03:34:20.701985 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 311/617] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:20 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:21.310344 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-434b8494-5a73-48c7-8974-85842c842580 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:21.312625 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-434b8494-5a73-48c7-8974-85842c842580 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:21.319154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-434b8494-5a73-48c7-8974-85842c842580 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:21.319669 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-434b8494-5a73-48c7-8974-85842c842580 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:21.320101 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-434b8494-5a73-48c7-8974-85842c842580 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:21.320771 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-434b8494-5a73-48c7-8974-85842c842580 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:21.321210 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-434b8494-5a73-48c7-8974-85842c842580 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:21.322267 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-434b8494-5a73-48c7-8974-85842c842580 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:21.353000 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-434b8494-5a73-48c7-8974-85842c842580 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047432 Oct 04 03:34:21.353540 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 307/618] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:34:21 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:21.724732 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-97040e64-8d46-4d15-9f4f-08734c68f267 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:21.725367 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-97040e64-8d46-4d15-9f4f-08734c68f267 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:21.732426 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97040e64-8d46-4d15-9f4f-08734c68f267 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:21.732900 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97040e64-8d46-4d15-9f4f-08734c68f267 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:21.733324 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97040e64-8d46-4d15-9f4f-08734c68f267 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:21.733996 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97040e64-8d46-4d15-9f4f-08734c68f267 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:21.734439 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97040e64-8d46-4d15-9f4f-08734c68f267 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:21.734851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97040e64-8d46-4d15-9f4f-08734c68f267 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:21.863632 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-97040e64-8d46-4d15-9f4f-08734c68f267 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:21.872263 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-97040e64-8d46-4d15-9f4f-08734c68f267 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1691 microversion: 2.1 time: 0.151348 Oct 04 03:34:21.872842 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 312/619] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:21 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:22.366142 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-1ad40125-071d-44f4-a67f-522fe9f62062 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:22.369161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-1ad40125-071d-44f4-a67f-522fe9f62062 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:22.376156 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1ad40125-071d-44f4-a67f-522fe9f62062 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:22.376634 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1ad40125-071d-44f4-a67f-522fe9f62062 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:22.377155 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1ad40125-071d-44f4-a67f-522fe9f62062 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:22.377906 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1ad40125-071d-44f4-a67f-522fe9f62062 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:22.377906 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1ad40125-071d-44f4-a67f-522fe9f62062 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:22.378760 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1ad40125-071d-44f4-a67f-522fe9f62062 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:22.407521 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-1ad40125-071d-44f4-a67f-522fe9f62062 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046105 Oct 04 03:34:22.408066 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 308/620] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:34:22 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:22.895255 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b74c232c-2da0-4022-8565-8b652d9ec673 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:22.895829 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b74c232c-2da0-4022-8565-8b652d9ec673 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:22.897939 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:22.903138 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b74c232c-2da0-4022-8565-8b652d9ec673 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:22.903645 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b74c232c-2da0-4022-8565-8b652d9ec673 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:22.904073 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b74c232c-2da0-4022-8565-8b652d9ec673 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:22.904750 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b74c232c-2da0-4022-8565-8b652d9ec673 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:22.905189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b74c232c-2da0-4022-8565-8b652d9ec673 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:22.905603 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b74c232c-2da0-4022-8565-8b652d9ec673 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:23.043833 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b74c232c-2da0-4022-8565-8b652d9ec673 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:23.051566 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b74c232c-2da0-4022-8565-8b652d9ec673 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1691 microversion: 2.1 time: 0.160194 Oct 04 03:34:23.052139 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 313/621] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:22 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:23.424476 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c7e889f3-7951-46fa-ad15-f87dc57ced67 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:23.426714 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c7e889f3-7951-46fa-ad15-f87dc57ced67 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:23.434801 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c7e889f3-7951-46fa-ad15-f87dc57ced67 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:23.435276 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c7e889f3-7951-46fa-ad15-f87dc57ced67 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:23.435736 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c7e889f3-7951-46fa-ad15-f87dc57ced67 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:23.436420 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c7e889f3-7951-46fa-ad15-f87dc57ced67 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:23.436863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c7e889f3-7951-46fa-ad15-f87dc57ced67 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:23.437371 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c7e889f3-7951-46fa-ad15-f87dc57ced67 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:23.470535 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c7e889f3-7951-46fa-ad15-f87dc57ced67 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052569 Oct 04 03:34:23.471107 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 309/622] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:34:23 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:34:24.076575 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-afe7a5ec-94db-41b6-b9d4-7014b7e0feea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:24.077206 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-afe7a5ec-94db-41b6-b9d4-7014b7e0feea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:24.083650 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-afe7a5ec-94db-41b6-b9d4-7014b7e0feea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:24.084136 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-afe7a5ec-94db-41b6-b9d4-7014b7e0feea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:24.084562 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-afe7a5ec-94db-41b6-b9d4-7014b7e0feea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:24.085281 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-afe7a5ec-94db-41b6-b9d4-7014b7e0feea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:24.085900 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-afe7a5ec-94db-41b6-b9d4-7014b7e0feea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:24.086326 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-afe7a5ec-94db-41b6-b9d4-7014b7e0feea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:24.305939 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-afe7a5ec-94db-41b6-b9d4-7014b7e0feea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:24.313985 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-afe7a5ec-94db-41b6-b9d4-7014b7e0feea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1691 microversion: 2.1 time: 0.241884 Oct 04 03:34:24.314558 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 314/623] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:24 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1691 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:24.484141 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-677584f0-c963-4913-aaae-2c9e16d3fea9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:24.486350 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-677584f0-c963-4913-aaae-2c9e16d3fea9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:24.492800 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-677584f0-c963-4913-aaae-2c9e16d3fea9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:24.493887 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-677584f0-c963-4913-aaae-2c9e16d3fea9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:24.494803 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-677584f0-c963-4913-aaae-2c9e16d3fea9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:24.495527 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-677584f0-c963-4913-aaae-2c9e16d3fea9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:24.495982 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-677584f0-c963-4913-aaae-2c9e16d3fea9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:24.496397 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-677584f0-c963-4913-aaae-2c9e16d3fea9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:24.525182 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-677584f0-c963-4913-aaae-2c9e16d3fea9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045365 Oct 04 03:34:24.525737 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 310/624] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:34:24 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 03:34:24.598560 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9015ed3d-d304-4f7b-8b46-f35ced689aea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:24.599051 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9015ed3d-d304-4f7b-8b46-f35ced689aea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:24.605712 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9015ed3d-d304-4f7b-8b46-f35ced689aea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:24.606184 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9015ed3d-d304-4f7b-8b46-f35ced689aea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:24.606606 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9015ed3d-d304-4f7b-8b46-f35ced689aea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:24.607286 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9015ed3d-d304-4f7b-8b46-f35ced689aea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:24.607836 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9015ed3d-d304-4f7b-8b46-f35ced689aea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:24.608255 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9015ed3d-d304-4f7b-8b46-f35ced689aea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:24.635549 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9015ed3d-d304-4f7b-8b46-f35ced689aea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:34:24.717852 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9015ed3d-d304-4f7b-8b46-f35ced689aea tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 204 len: 0 microversion: 2.1 time: 0.122926 Oct 04 03:34:24.718946 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 315/625] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:34:24 2022] DELETE /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:34:24.732387 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-4e05ac0d-e101-470f-95bf-7074f2d06bec tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:24.733103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-4e05ac0d-e101-470f-95bf-7074f2d06bec tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:24.742334 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4e05ac0d-e101-470f-95bf-7074f2d06bec tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:24.742850 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4e05ac0d-e101-470f-95bf-7074f2d06bec tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:24.744939 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4e05ac0d-e101-470f-95bf-7074f2d06bec tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:24.745816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4e05ac0d-e101-470f-95bf-7074f2d06bec tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:24.747083 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4e05ac0d-e101-470f-95bf-7074f2d06bec tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:24.747533 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4e05ac0d-e101-470f-95bf-7074f2d06bec tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:25.220224 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4e05ac0d-e101-470f-95bf-7074f2d06bec tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:25.228661 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-4e05ac0d-e101-470f-95bf-7074f2d06bec tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1681 microversion: 2.1 time: 0.504151 Oct 04 03:34:25.229238 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 311/626] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:24 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1681 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:25.328821 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-5aa0f4af-4081-4389-b6fc-dabe06a734ef req-935ecb6d-a71c-47f2-a76a-910d16142886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a2b849-4aeb-4b38-8204-9a1b6c3983d8", "name": "network-vif-deleted", "tag": "c33a6354-d3b9-46e0-8da8-baff5c9a347a"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:25.336813 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-3fffcdf2-a600-4755-834b-20dd83374a13 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:25.338133 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-3fffcdf2-a600-4755-834b-20dd83374a13 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:25.341630 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-5aa0f4af-4081-4389-b6fc-dabe06a734ef req-935ecb6d-a71c-47f2-a76a-910d16142886 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:25.342108 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-5aa0f4af-4081-4389-b6fc-dabe06a734ef req-935ecb6d-a71c-47f2-a76a-910d16142886 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:25.342533 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-5aa0f4af-4081-4389-b6fc-dabe06a734ef req-935ecb6d-a71c-47f2-a76a-910d16142886 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:25.344579 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3fffcdf2-a600-4755-834b-20dd83374a13 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:25.345067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3fffcdf2-a600-4755-834b-20dd83374a13 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:25.345498 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3fffcdf2-a600-4755-834b-20dd83374a13 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:25.346183 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3fffcdf2-a600-4755-834b-20dd83374a13 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:25.346811 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3fffcdf2-a600-4755-834b-20dd83374a13 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:25.347237 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3fffcdf2-a600-4755-834b-20dd83374a13 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:25.354375 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-5aa0f4af-4081-4389-b6fc-dabe06a734ef req-935ecb6d-a71c-47f2-a76a-910d16142886 service nova] Creating event network-vif-deleted:c33a6354-d3b9-46e0-8da8-baff5c9a347a for instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 on hv-cinder-84914 Oct 04 03:34:25.359154 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-5aa0f4af-4081-4389-b6fc-dabe06a734ef req-935ecb6d-a71c-47f2-a76a-910d16142886 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034440 Oct 04 03:34:25.359962 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 316/627] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:25.413176 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-3fffcdf2-a600-4755-834b-20dd83374a13 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:25.421029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-3fffcdf2-a600-4755-834b-20dd83374a13 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1623 microversion: 2.1 time: 0.088123 Oct 04 03:34:25.421592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 312/628] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:25 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1623 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:26.255943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2274f837-17ae-49f4-93d4-89722c00c50f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:26.257175 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2274f837-17ae-49f4-93d4-89722c00c50f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:26.265691 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2274f837-17ae-49f4-93d4-89722c00c50f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:26.266231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2274f837-17ae-49f4-93d4-89722c00c50f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:26.266692 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2274f837-17ae-49f4-93d4-89722c00c50f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:26.267475 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2274f837-17ae-49f4-93d4-89722c00c50f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:26.268332 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2274f837-17ae-49f4-93d4-89722c00c50f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:26.268751 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2274f837-17ae-49f4-93d4-89722c00c50f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:26.406949 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2274f837-17ae-49f4-93d4-89722c00c50f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:26.415360 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2274f837-17ae-49f4-93d4-89722c00c50f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1681 microversion: 2.1 time: 0.164274 Oct 04 03:34:26.416173 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 317/629] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:26 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:26.444316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a3b3608f-6da0-4cd6-986e-be35bc09b560 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:26.445064 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a3b3608f-6da0-4cd6-986e-be35bc09b560 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:26.452713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a3b3608f-6da0-4cd6-986e-be35bc09b560 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:26.453191 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a3b3608f-6da0-4cd6-986e-be35bc09b560 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:26.453647 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a3b3608f-6da0-4cd6-986e-be35bc09b560 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:26.454332 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a3b3608f-6da0-4cd6-986e-be35bc09b560 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:26.454783 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a3b3608f-6da0-4cd6-986e-be35bc09b560 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:26.455196 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a3b3608f-6da0-4cd6-986e-be35bc09b560 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:26.486927 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a3b3608f-6da0-4cd6-986e-be35bc09b560 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:26.487403 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a3b3608f-6da0-4cd6-986e-be35bc09b560 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:26.487865 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a3b3608f-6da0-4cd6-986e-be35bc09b560 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:26.488302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-a3b3608f-6da0-4cd6-986e-be35bc09b560 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lazy-loading 'fault' on Instance uuid 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:34:26.548048 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a3b3608f-6da0-4cd6-986e-be35bc09b560 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:26.557646 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a3b3608f-6da0-4cd6-986e-be35bc09b560 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 200 len: 1335 microversion: 2.1 time: 0.117381 Oct 04 03:34:26.558418 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 313/630] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:26 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 1335 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:27.377622 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-74bca227-b741-48fd-bb68-762676085b02 req-b92537fa-41fa-40ed-a932-4cb68e2afa5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa285589-057b-4a56-9da5-614e561bb64b", "name": "network-vif-deleted", "tag": "2894bf1c-f43d-482f-921b-831aac745902"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:27.388691 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-74bca227-b741-48fd-bb68-762676085b02 req-b92537fa-41fa-40ed-a932-4cb68e2afa5a service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:27.389184 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-74bca227-b741-48fd-bb68-762676085b02 req-b92537fa-41fa-40ed-a932-4cb68e2afa5a service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:27.389690 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-74bca227-b741-48fd-bb68-762676085b02 req-b92537fa-41fa-40ed-a932-4cb68e2afa5a service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:27.401026 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-74bca227-b741-48fd-bb68-762676085b02 req-b92537fa-41fa-40ed-a932-4cb68e2afa5a service nova] Creating event network-vif-deleted:2894bf1c-f43d-482f-921b-831aac745902 for instance fa285589-057b-4a56-9da5-614e561bb64b on hv-cinder-84914 Oct 04 03:34:27.405873 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-74bca227-b741-48fd-bb68-762676085b02 req-b92537fa-41fa-40ed-a932-4cb68e2afa5a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032306 Oct 04 03:34:27.407085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 318/631] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:27.441672 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-bc0b3e09-f353-4c22-a2d6-35612e3d8c2c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:27.443677 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-bc0b3e09-f353-4c22-a2d6-35612e3d8c2c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:27.453475 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bc0b3e09-f353-4c22-a2d6-35612e3d8c2c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:27.454851 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bc0b3e09-f353-4c22-a2d6-35612e3d8c2c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:27.455564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bc0b3e09-f353-4c22-a2d6-35612e3d8c2c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:27.456868 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bc0b3e09-f353-4c22-a2d6-35612e3d8c2c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:27.458278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bc0b3e09-f353-4c22-a2d6-35612e3d8c2c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:27.458940 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bc0b3e09-f353-4c22-a2d6-35612e3d8c2c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:27.500480 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bc0b3e09-f353-4c22-a2d6-35612e3d8c2c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:27.500963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bc0b3e09-f353-4c22-a2d6-35612e3d8c2c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:27.501390 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bc0b3e09-f353-4c22-a2d6-35612e3d8c2c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:27.501830 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-bc0b3e09-f353-4c22-a2d6-35612e3d8c2c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lazy-loading 'fault' on Instance uuid fa285589-057b-4a56-9da5-614e561bb64b {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:34:27.582159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d02e0ba6-392a-421a-97f5-223eea4b1ae1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:27.583227 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d02e0ba6-392a-421a-97f5-223eea4b1ae1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 36a2b849-4aeb-4b38-8204-9a1b6c3983d8] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:27.596959 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d02e0ba6-392a-421a-97f5-223eea4b1ae1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:27.597514 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d02e0ba6-392a-421a-97f5-223eea4b1ae1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:27.598011 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d02e0ba6-392a-421a-97f5-223eea4b1ae1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:27.598788 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d02e0ba6-392a-421a-97f5-223eea4b1ae1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:27.599284 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d02e0ba6-392a-421a-97f5-223eea4b1ae1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:27.599793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d02e0ba6-392a-421a-97f5-223eea4b1ae1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:27.624063 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-d02e0ba6-392a-421a-97f5-223eea4b1ae1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] HTTP exception thrown: Instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 could not be found. Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d02e0ba6-392a-421a-97f5-223eea4b1ae1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Request method failure captured: Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 HTTP/1.1 Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6iuldyrIBbW0f73v2K7ATYrextCGz2-_Yc58_h0cv-5TQFrImJgI3vgI3ryyGo9OGTifdm0w3ZapIKJj0Fj0su00BfHCMYaElTS2T4ES-IzJv9KifpjH3rp-cobaqB4aXjivbFQVaV2D5PTfUOLh5YQ34ZK3qeegc9sqNgzArwYGQ4 Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: b62fd4925f3840edb9806630cd78c9fa Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:34:27.629192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:34:27.630624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b62fd4925f3840edb9806630cd78c9fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b62fd4925f3840edb9806630cd78c9fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b62fd4925f3840edb9806630cd78c9fa", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b62fd4925f3840edb9806630cd78c9fa"}]}] Oct 04 03:34:27.630624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:34:27.630624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: b62fd4925f3840edb9806630cd78c9fa Oct 04 03:34:27.630624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:34:27.630624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-ServerRescueNegativeTestJSON-465130473-project Oct 04 03:34:27.630624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:34:27.630624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:34:27.630624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: a267cf7109c64f538824c162fedd084b Oct 04 03:34:27.630624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-465130473-project Oct 04 03:34:27.630624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:34:27.630624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 could not be found. Oct 04 03:34:27.630624 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '36a2b849-4aeb-4b38-8204-9a1b6c3983d8'} Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 could not be found. Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:34:27.631478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 could not be found. Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 could not be found. Oct 04 03:34:27.633101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:27.636878 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d02e0ba6-392a-421a-97f5-223eea4b1ae1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Returning 404 to user: Instance 36a2b849-4aeb-4b38-8204-9a1b6c3983d8 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:34:27.638540 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d02e0ba6-392a-421a-97f5-223eea4b1ae1 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8" status: 404 len: 111 microversion: 2.1 time: 0.060789 Oct 04 03:34:27.639709 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 319/632] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:27 2022] GET /compute/v2.1/servers/36a2b849-4aeb-4b38-8204-9a1b6c3983d8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:34:27.650109 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-69f819fb-ae6e-43f8-8114-cb212417ad50 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '.version_select at 0x7f165b3b44c0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:27.694199 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-69f819fb-ae6e-43f8-8114-cb212417ad50 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-111869487" status: 202 len: 0 microversion: 2.1 time: 0.050414 Oct 04 03:34:27.698707 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 320/633] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Oct 4 03:34:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-111869487 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 03:34:27.821045 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-bc0b3e09-f353-4c22-a2d6-35612e3d8c2c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:27.830187 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-bc0b3e09-f353-4c22-a2d6-35612e3d8c2c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 200 len: 1331 microversion: 2.1 time: 0.393103 Oct 04 03:34:27.830947 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 314/634] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:27 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 1331 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:28.854439 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-882f61d4-073e-4491-a3ee-e3cdc0b1ab48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:28.855097 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-882f61d4-073e-4491-a3ee-e3cdc0b1ab48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:28.863330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-882f61d4-073e-4491-a3ee-e3cdc0b1ab48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:28.863827 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-882f61d4-073e-4491-a3ee-e3cdc0b1ab48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:28.864250 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-882f61d4-073e-4491-a3ee-e3cdc0b1ab48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:28.864927 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-882f61d4-073e-4491-a3ee-e3cdc0b1ab48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:28.865368 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-882f61d4-073e-4491-a3ee-e3cdc0b1ab48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:28.865779 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-882f61d4-073e-4491-a3ee-e3cdc0b1ab48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:28.878716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-882f61d4-073e-4491-a3ee-e3cdc0b1ab48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] HTTP exception thrown: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-882f61d4-073e-4491-a3ee-e3cdc0b1ab48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Request method failure captured: Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b HTTP/1.1 Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6isUYhgYsAb2pqxJ5i2_6gzGtKyJzLe2quMbLKiFrXtrxQIhaAv2XwsUqEAkN7Fh1WqlIXaqgH_JRfN3W7XWKG2TyqZRi_OBW_0jILA2kaoQ2SSAvWUeuuoQxbaW7Q90VlSmfhWYx2fgtTX4JS2Hb0X2tvDyvvlYbTndLm_mtGSa4s Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:34:28.880261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:34:28.881902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d6ee89cb464afa95e222b2a1e7279b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d6ee89cb464afa95e222b2a1e7279b"}]}] Oct 04 03:34:28.881902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:34:28.881902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:34:28.881902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:34:28.881902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:34:28.881902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:34:28.881902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:34:28.881902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: b8795829c34046628cae345dd4d45e75 Oct 04 03:34:28.881902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:34:28.881902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:34:28.881902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:34:28.881902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': 'fa285589-057b-4a56-9da5-614e561bb64b'} Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:34:28.882837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:34:28.884589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:28.885910 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-882f61d4-073e-4491-a3ee-e3cdc0b1ab48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Returning 404 to user: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:34:28.885910 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-882f61d4-073e-4491-a3ee-e3cdc0b1ab48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 404 len: 111 microversion: 2.1 time: 0.031256 Oct 04 03:34:28.885910 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 321/635] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:28 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:34:28.893046 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-ddd9c0b6-1009-4fbb-aa8a-36a830493f42 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '.version_select at 0x7f165b485af0>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:28.911606 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-ddd9c0b6-1009-4fbb-aa8a-36a830493f42 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-641844043" status: 202 len: 0 microversion: 2.1 time: 0.022698 Oct 04 03:34:28.912156 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 315/636] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Oct 4 03:34:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-641844043 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:34:29.521695 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a3417454-e4fb-47e5-9237-c64ee46c8e04 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Action: 'create', calling method: .version_select at 0x7f165b3b4ca0>, body: {"keypair": {"name": "tempest-keypair-1223998132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYb23LUO1NIe+rlqNEsllqMikSZWyZXI+0wQwT6e1NhhdpWC/WvSdcsz/f0Z9Kn89tbkO5iSLC6qiwVZ1kveh7bEzvyw5cr+tuv6UIPKJqIx2Mj9fA1chNW46kxS8HniA=="}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:29.538596 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-a3417454-e4fb-47e5-9237-c64ee46c8e04 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:34:29.542627 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-a3417454-e4fb-47e5-9237-c64ee46c8e04 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for user b8795829c34046628cae345dd4d45e75 and project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:34:29.565655 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a3417454-e4fb-47e5-9237-c64ee46c8e04 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048087 Oct 04 03:34:29.573427 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 322/637] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Oct 4 03:34:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:30.628196 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c872d43d-06ee-41b8-8a6d-12f03a8e1507 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:30.628718 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c872d43d-06ee-41b8-8a6d-12f03a8e1507 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:30.636216 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c872d43d-06ee-41b8-8a6d-12f03a8e1507 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:30.636713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c872d43d-06ee-41b8-8a6d-12f03a8e1507 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:30.637370 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c872d43d-06ee-41b8-8a6d-12f03a8e1507 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:30.638076 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c872d43d-06ee-41b8-8a6d-12f03a8e1507 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:30.638689 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c872d43d-06ee-41b8-8a6d-12f03a8e1507 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:30.639121 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c872d43d-06ee-41b8-8a6d-12f03a8e1507 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:30.658743 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:30.670481 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c872d43d-06ee-41b8-8a6d-12f03a8e1507 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Going to try to terminate instance {{(pid=120595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:34:30.758180 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c872d43d-06ee-41b8-8a6d-12f03a8e1507 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 204 len: 0 microversion: 2.1 time: 0.134054 Oct 04 03:34:30.759697 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 316/638] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:34:30 2022] DELETE /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:34:30.768110 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3dfc6afe-e1a5-4e6b-95c0-d59dff0fc08e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:30.768722 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3dfc6afe-e1a5-4e6b-95c0-d59dff0fc08e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:30.777992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dfc6afe-e1a5-4e6b-95c0-d59dff0fc08e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:30.778479 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dfc6afe-e1a5-4e6b-95c0-d59dff0fc08e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:30.779065 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dfc6afe-e1a5-4e6b-95c0-d59dff0fc08e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:30.779834 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dfc6afe-e1a5-4e6b-95c0-d59dff0fc08e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:30.780875 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dfc6afe-e1a5-4e6b-95c0-d59dff0fc08e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:30.781330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dfc6afe-e1a5-4e6b-95c0-d59dff0fc08e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:30.859912 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1126715783", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "86d4958b-fe69-4a74-b4b0-c186c2f360dd"}], "security_groups": [{"name": "tempest-securitygroup--164608609"}], "key_name": "tempest-keypair-1223998132", "user_data": "}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:31.001800 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.network.neutron [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] validate_networks() for [('86d4958b-fe69-4a74-b4b0-c186c2f360dd', None, None, None, None, None)] {{(pid=120595) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:34:31.007778 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-3dfc6afe-e1a5-4e6b-95c0-d59dff0fc08e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:31.016092 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3dfc6afe-e1a5-4e6b-95c0-d59dff0fc08e tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1508 microversion: 2.1 time: 0.252373 Oct 04 03:34:31.016873 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 323/639] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:30 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:31.362080 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Flavor limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:34:31.362497 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Image limits 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:34:31.362967 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Flavor pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:34:31.363375 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Image pref 0:0:0 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:34:31.363826 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.virt.hardware [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:34:31.376424 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:31.377222 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:31.377665 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:31.378395 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:31.378848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:31.379271 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:31.395776 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:34:31.399932 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Getting quotas for user b8795829c34046628cae345dd4d45e75 and project a8d6ee89cb464afa95e222b2a1e7279b. Resources: {'instances', 'ram', 'cores'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:34:31.410588 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Going to run 1 instances... {{(pid=120595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:34:31.412972 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:34:31.460914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6cf1dcaf-fb3a-4709-9451-65ebdf0e048c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.605609 Oct 04 03:34:31.461557 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 317/640] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:34:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 03:34:31.473072 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1e2fb9b3-2159-49e8-89e7-4f705602e841 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:31.473672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1e2fb9b3-2159-49e8-89e7-4f705602e841 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:31.530890 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1e2fb9b3-2159-49e8-89e7-4f705602e841 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:31.537838 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1e2fb9b3-2159-49e8-89e7-4f705602e841 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1242 microversion: 2.1 time: 0.068674 Oct 04 03:34:31.538420 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 324/641] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:31 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:32.039659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e983dd39-2fea-4074-8572-280bdcf817a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:32.041114 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e983dd39-2fea-4074-8572-280bdcf817a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:32.047360 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e983dd39-2fea-4074-8572-280bdcf817a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:32.047875 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e983dd39-2fea-4074-8572-280bdcf817a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:32.048334 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e983dd39-2fea-4074-8572-280bdcf817a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:32.049012 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e983dd39-2fea-4074-8572-280bdcf817a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:32.049458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e983dd39-2fea-4074-8572-280bdcf817a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:32.049910 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e983dd39-2fea-4074-8572-280bdcf817a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:32.179664 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e983dd39-2fea-4074-8572-280bdcf817a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:32.187937 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e983dd39-2fea-4074-8572-280bdcf817a7 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1508 microversion: 2.1 time: 0.152592 Oct 04 03:34:32.188510 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 318/642] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:32 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:32.561216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1d3fb652-8904-4513-98e5-1a5351d9962a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:32.561881 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1d3fb652-8904-4513-98e5-1a5351d9962a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:32.569244 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d3fb652-8904-4513-98e5-1a5351d9962a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:32.569718 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d3fb652-8904-4513-98e5-1a5351d9962a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:32.570144 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d3fb652-8904-4513-98e5-1a5351d9962a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:32.570822 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d3fb652-8904-4513-98e5-1a5351d9962a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:32.571921 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d3fb652-8904-4513-98e5-1a5351d9962a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:32.572433 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d3fb652-8904-4513-98e5-1a5351d9962a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:32.634871 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1d3fb652-8904-4513-98e5-1a5351d9962a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:32.643071 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1d3fb652-8904-4513-98e5-1a5351d9962a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1246 microversion: 2.1 time: 0.085710 Oct 04 03:34:32.643665 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 325/643] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:32 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:33.211461 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-1ae87536-c9d8-4378-bcd6-e18a895cb6ee tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:33.212586 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-1ae87536-c9d8-4378-bcd6-e18a895cb6ee tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:33.219336 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1ae87536-c9d8-4378-bcd6-e18a895cb6ee tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:33.219845 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1ae87536-c9d8-4378-bcd6-e18a895cb6ee tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:33.220275 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1ae87536-c9d8-4378-bcd6-e18a895cb6ee tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:33.220949 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1ae87536-c9d8-4378-bcd6-e18a895cb6ee tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:33.221392 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1ae87536-c9d8-4378-bcd6-e18a895cb6ee tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:33.221807 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1ae87536-c9d8-4378-bcd6-e18a895cb6ee tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:33.434364 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-1ae87536-c9d8-4378-bcd6-e18a895cb6ee tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:33.442092 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-1ae87536-c9d8-4378-bcd6-e18a895cb6ee tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1508 microversion: 2.1 time: 0.235142 Oct 04 03:34:33.442668 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 319/644] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:33 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:33.671086 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1a2202c6-de40-4578-ab79-ea638b713a48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:33.671891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1a2202c6-de40-4578-ab79-ea638b713a48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:33.687165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a2202c6-de40-4578-ab79-ea638b713a48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:33.687815 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a2202c6-de40-4578-ab79-ea638b713a48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:33.688498 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a2202c6-de40-4578-ab79-ea638b713a48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:33.689151 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a2202c6-de40-4578-ab79-ea638b713a48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:33.689581 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a2202c6-de40-4578-ab79-ea638b713a48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:33.689992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a2202c6-de40-4578-ab79-ea638b713a48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:33.809545 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1a2202c6-de40-4578-ab79-ea638b713a48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:33.832480 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-5b38dbac-ee1d-4975-8675-99936c25e870 req-89b818d5-0c25-447b-b389-6bdae086b609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0a3732-a69d-4749-ad7e-c24ae04bbb44", "name": "network-vif-deleted", "tag": "57c37564-5b7c-476f-9220-e715c56dbbb2"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:33.833889 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1a2202c6-de40-4578-ab79-ea638b713a48 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1294 microversion: 2.1 time: 0.166088 Oct 04 03:34:33.847804 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-5b38dbac-ee1d-4975-8675-99936c25e870 req-89b818d5-0c25-447b-b389-6bdae086b609 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:33.848275 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-5b38dbac-ee1d-4975-8675-99936c25e870 req-89b818d5-0c25-447b-b389-6bdae086b609 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:33.848883 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-5b38dbac-ee1d-4975-8675-99936c25e870 req-89b818d5-0c25-447b-b389-6bdae086b609 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:33.855640 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 326/645] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:33 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1294 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:33.867702 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-5b38dbac-ee1d-4975-8675-99936c25e870 req-89b818d5-0c25-447b-b389-6bdae086b609 service nova] Creating event network-vif-deleted:57c37564-5b7c-476f-9220-e715c56dbbb2 for instance 9a0a3732-a69d-4749-ad7e-c24ae04bbb44 on hv-cinder-84914 Oct 04 03:34:33.875258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-5b38dbac-ee1d-4975-8675-99936c25e870 req-89b818d5-0c25-447b-b389-6bdae086b609 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047267 Oct 04 03:34:33.880642 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 320/646] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:34:34.466875 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5917bc14-3b66-43c7-9302-058029c297d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:34.467472 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5917bc14-3b66-43c7-9302-058029c297d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:34.473314 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5917bc14-3b66-43c7-9302-058029c297d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:34.473789 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5917bc14-3b66-43c7-9302-058029c297d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:34.474207 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5917bc14-3b66-43c7-9302-058029c297d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:34.474886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5917bc14-3b66-43c7-9302-058029c297d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:34.475329 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5917bc14-3b66-43c7-9302-058029c297d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:34.475772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5917bc14-3b66-43c7-9302-058029c297d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:34.510800 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5917bc14-3b66-43c7-9302-058029c297d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:34.511284 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5917bc14-3b66-43c7-9302-058029c297d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:34.511749 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5917bc14-3b66-43c7-9302-058029c297d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:34.512187 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-5917bc14-3b66-43c7-9302-058029c297d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lazy-loading 'fault' on Instance uuid 9a0a3732-a69d-4749-ad7e-c24ae04bbb44 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:34:34.561473 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5917bc14-3b66-43c7-9302-058029c297d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:34.570388 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5917bc14-3b66-43c7-9302-058029c297d4 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 200 len: 1312 microversion: 2.1 time: 0.107366 Oct 04 03:34:34.571457 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 327/647] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:34 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:34.865573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-73055c7a-72e8-4e3d-a41b-911ed09afab9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:34.867166 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-73055c7a-72e8-4e3d-a41b-911ed09afab9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:34.876545 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-73055c7a-72e8-4e3d-a41b-911ed09afab9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:34.877153 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-73055c7a-72e8-4e3d-a41b-911ed09afab9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:34.877672 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-73055c7a-72e8-4e3d-a41b-911ed09afab9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:34.878444 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-73055c7a-72e8-4e3d-a41b-911ed09afab9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:34.878971 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-73055c7a-72e8-4e3d-a41b-911ed09afab9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:34.879467 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-73055c7a-72e8-4e3d-a41b-911ed09afab9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:35.021316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-73055c7a-72e8-4e3d-a41b-911ed09afab9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:35.033895 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-73055c7a-72e8-4e3d-a41b-911ed09afab9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1367 microversion: 2.1 time: 0.172877 Oct 04 03:34:35.034953 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 321/648] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:34 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:35.559440 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-4c4534a6-98b8-4c6d-b6a6-20d9e7f4f3ff req-9e5d46d7-3b51-4fa9-a55f-2d319f581aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d704ae4-024f-4f05-8c08-2853b755b031", "tag": "972122cd-e121-416b-a905-f6ab52c59458"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:35.573910 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-4c4534a6-98b8-4c6d-b6a6-20d9e7f4f3ff req-9e5d46d7-3b51-4fa9-a55f-2d319f581aa6 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:35.574883 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-4c4534a6-98b8-4c6d-b6a6-20d9e7f4f3ff req-9e5d46d7-3b51-4fa9-a55f-2d319f581aa6 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:35.574883 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-4c4534a6-98b8-4c6d-b6a6-20d9e7f4f3ff req-9e5d46d7-3b51-4fa9-a55f-2d319f581aa6 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:35.587982 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-4c4534a6-98b8-4c6d-b6a6-20d9e7f4f3ff req-9e5d46d7-3b51-4fa9-a55f-2d319f581aa6 service nova] Creating event network-changed:972122cd-e121-416b-a905-f6ab52c59458 for instance 4d704ae4-024f-4f05-8c08-2853b755b031 on hv-cinder-84914 Oct 04 03:34:35.593391 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-4c4534a6-98b8-4c6d-b6a6-20d9e7f4f3ff req-9e5d46d7-3b51-4fa9-a55f-2d319f581aa6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038552 Oct 04 03:34:35.594341 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 328/649] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:35.594632 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-51570b6a-0bfd-45d4-90f9-01defd47ad5d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:35.595235 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-51570b6a-0bfd-45d4-90f9-01defd47ad5d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 9a0a3732-a69d-4749-ad7e-c24ae04bbb44] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:35.601768 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-51570b6a-0bfd-45d4-90f9-01defd47ad5d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:35.602450 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-51570b6a-0bfd-45d4-90f9-01defd47ad5d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:35.602883 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-51570b6a-0bfd-45d4-90f9-01defd47ad5d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:35.603614 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-51570b6a-0bfd-45d4-90f9-01defd47ad5d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:35.604061 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-51570b6a-0bfd-45d4-90f9-01defd47ad5d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:35.604479 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-51570b6a-0bfd-45d4-90f9-01defd47ad5d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:35.619297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-51570b6a-0bfd-45d4-90f9-01defd47ad5d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] HTTP exception thrown: Instance 9a0a3732-a69d-4749-ad7e-c24ae04bbb44 could not be found. Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-51570b6a-0bfd-45d4-90f9-01defd47ad5d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Request method failure captured: Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 HTTP/1.1 Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6iuldyrIBbW0f73v2K7ATYrextCGz2-_Yc58_h0cv-5TQFrImJgI3vgI3ryyGo9OGTifdm0w3ZapIKJj0Fj0su00BfHCMYaElTS2T4ES-IzJv9KifpjH3rp-cobaqB4aXjivbFQVaV2D5PTfUOLh5YQ34ZK3qeegc9sqNgzArwYGQ4 Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: b62fd4925f3840edb9806630cd78c9fa Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:34:35.620974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:34:35.622587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b62fd4925f3840edb9806630cd78c9fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b62fd4925f3840edb9806630cd78c9fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b62fd4925f3840edb9806630cd78c9fa", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b62fd4925f3840edb9806630cd78c9fa"}]}] Oct 04 03:34:35.622587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:34:35.622587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: b62fd4925f3840edb9806630cd78c9fa Oct 04 03:34:35.622587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:34:35.622587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-ServerRescueNegativeTestJSON-465130473-project Oct 04 03:34:35.622587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:34:35.622587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:34:35.622587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: a267cf7109c64f538824c162fedd084b Oct 04 03:34:35.622587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-465130473-project Oct 04 03:34:35.622587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:34:35.622587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance 9a0a3732-a69d-4749-ad7e-c24ae04bbb44 could not be found. Oct 04 03:34:35.622587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '9a0a3732-a69d-4749-ad7e-c24ae04bbb44'} Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a0a3732-a69d-4749-ad7e-c24ae04bbb44 could not be found. Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:34:35.623520 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a0a3732-a69d-4749-ad7e-c24ae04bbb44 could not be found. Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a0a3732-a69d-4749-ad7e-c24ae04bbb44 could not be found. Oct 04 03:34:35.624955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:35.626221 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-51570b6a-0bfd-45d4-90f9-01defd47ad5d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Returning 404 to user: Instance 9a0a3732-a69d-4749-ad7e-c24ae04bbb44 could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:34:35.626221 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-51570b6a-0bfd-45d4-90f9-01defd47ad5d tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44" status: 404 len: 111 microversion: 2.1 time: 0.031686 Oct 04 03:34:35.626221 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 322/650] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:35 2022] GET /compute/v2.1/servers/9a0a3732-a69d-4749-ad7e-c24ae04bbb44 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 03:34:35.631986 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cf165cda-44b0-4326-99db-cf80459cdc07 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:35.632576 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cf165cda-44b0-4326-99db-cf80459cdc07 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:35.640276 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cf165cda-44b0-4326-99db-cf80459cdc07 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:35.641019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cf165cda-44b0-4326-99db-cf80459cdc07 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:35.641837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cf165cda-44b0-4326-99db-cf80459cdc07 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:35.642273 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cf165cda-44b0-4326-99db-cf80459cdc07 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:35.642793 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cf165cda-44b0-4326-99db-cf80459cdc07 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:35.643281 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cf165cda-44b0-4326-99db-cf80459cdc07 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:35.661598 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:35.670126 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cf165cda-44b0-4326-99db-cf80459cdc07 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:34:35.749254 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cf165cda-44b0-4326-99db-cf80459cdc07 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "DELETE /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 204 len: 0 microversion: 2.1 time: 0.121294 Oct 04 03:34:35.750076 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 329/651] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:34:35 2022] DELETE /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:34:35.758334 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-3d9cb042-4e2d-4954-8d21-3916139e1d10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:35.759062 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-3d9cb042-4e2d-4954-8d21-3916139e1d10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:35.764919 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3d9cb042-4e2d-4954-8d21-3916139e1d10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:35.765390 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3d9cb042-4e2d-4954-8d21-3916139e1d10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:35.765819 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3d9cb042-4e2d-4954-8d21-3916139e1d10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:35.766489 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3d9cb042-4e2d-4954-8d21-3916139e1d10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:35.766938 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3d9cb042-4e2d-4954-8d21-3916139e1d10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:35.767352 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3d9cb042-4e2d-4954-8d21-3916139e1d10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:35.896597 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-3d9cb042-4e2d-4954-8d21-3916139e1d10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:35.904573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-3d9cb042-4e2d-4954-8d21-3916139e1d10 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.150409 Oct 04 03:34:35.905136 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 323/652] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:35 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:36.058860 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-74e666d7-c31d-45ee-a490-0a70a8f3ce7a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:36.059590 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-74e666d7-c31d-45ee-a490-0a70a8f3ce7a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:36.065477 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-74e666d7-c31d-45ee-a490-0a70a8f3ce7a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:36.065960 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-74e666d7-c31d-45ee-a490-0a70a8f3ce7a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:36.066392 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-74e666d7-c31d-45ee-a490-0a70a8f3ce7a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:36.067088 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-74e666d7-c31d-45ee-a490-0a70a8f3ce7a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:36.067567 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-74e666d7-c31d-45ee-a490-0a70a8f3ce7a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:36.067992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-74e666d7-c31d-45ee-a490-0a70a8f3ce7a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:36.199370 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-74e666d7-c31d-45ee-a490-0a70a8f3ce7a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:36.206903 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-74e666d7-c31d-45ee-a490-0a70a8f3ce7a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1367 microversion: 2.1 time: 0.153016 Oct 04 03:34:36.207476 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 330/653] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:36 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:36.928381 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-026f26e3-df65-42de-b8f2-5c4d75ac46a5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:36.928907 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-026f26e3-df65-42de-b8f2-5c4d75ac46a5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:36.935775 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-026f26e3-df65-42de-b8f2-5c4d75ac46a5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:36.936248 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-026f26e3-df65-42de-b8f2-5c4d75ac46a5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:36.936674 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-026f26e3-df65-42de-b8f2-5c4d75ac46a5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:36.937348 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-026f26e3-df65-42de-b8f2-5c4d75ac46a5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:36.937790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-026f26e3-df65-42de-b8f2-5c4d75ac46a5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:36.938203 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-026f26e3-df65-42de-b8f2-5c4d75ac46a5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:37.065144 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-026f26e3-df65-42de-b8f2-5c4d75ac46a5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:37.073988 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-026f26e3-df65-42de-b8f2-5c4d75ac46a5 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.149496 Oct 04 03:34:37.074540 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 324/654] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:36 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:37.230203 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7ec3c2fd-fc14-47b0-9726-5280abdca622 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:37.230810 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7ec3c2fd-fc14-47b0-9726-5280abdca622 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:37.237184 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7ec3c2fd-fc14-47b0-9726-5280abdca622 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:37.237659 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7ec3c2fd-fc14-47b0-9726-5280abdca622 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:37.238118 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7ec3c2fd-fc14-47b0-9726-5280abdca622 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:37.238801 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7ec3c2fd-fc14-47b0-9726-5280abdca622 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:37.239247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7ec3c2fd-fc14-47b0-9726-5280abdca622 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:37.239696 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7ec3c2fd-fc14-47b0-9726-5280abdca622 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:37.371380 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-7ec3c2fd-fc14-47b0-9726-5280abdca622 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:37.378982 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7ec3c2fd-fc14-47b0-9726-5280abdca622 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1367 microversion: 2.1 time: 0.153087 Oct 04 03:34:37.379554 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 331/655] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:37 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:38.096753 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7f1e043b-3873-4b3a-bd00-f9cf3a1085ea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:38.097354 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-7f1e043b-3873-4b3a-bd00-f9cf3a1085ea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:38.103748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7f1e043b-3873-4b3a-bd00-f9cf3a1085ea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:38.104223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7f1e043b-3873-4b3a-bd00-f9cf3a1085ea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:38.104654 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7f1e043b-3873-4b3a-bd00-f9cf3a1085ea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:38.105327 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7f1e043b-3873-4b3a-bd00-f9cf3a1085ea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:38.105773 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7f1e043b-3873-4b3a-bd00-f9cf3a1085ea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:38.106192 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7f1e043b-3873-4b3a-bd00-f9cf3a1085ea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:38.232855 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7f1e043b-3873-4b3a-bd00-f9cf3a1085ea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:38.240406 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-7f1e043b-3873-4b3a-bd00-f9cf3a1085ea tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.147540 Oct 04 03:34:38.240966 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 325/656] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:38 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:38.401013 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c982f47b-34f7-4207-9ed4-f5ea0b677f0e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:38.401523 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c982f47b-34f7-4207-9ed4-f5ea0b677f0e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:38.407880 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c982f47b-34f7-4207-9ed4-f5ea0b677f0e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:38.408354 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c982f47b-34f7-4207-9ed4-f5ea0b677f0e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:38.408778 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c982f47b-34f7-4207-9ed4-f5ea0b677f0e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:38.409449 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c982f47b-34f7-4207-9ed4-f5ea0b677f0e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:38.409892 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c982f47b-34f7-4207-9ed4-f5ea0b677f0e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:38.410303 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c982f47b-34f7-4207-9ed4-f5ea0b677f0e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:38.534025 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c982f47b-34f7-4207-9ed4-f5ea0b677f0e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:38.542183 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c982f47b-34f7-4207-9ed4-f5ea0b677f0e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1367 microversion: 2.1 time: 0.145258 Oct 04 03:34:38.542742 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 332/657] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:38 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:39.265845 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7596f520-396f-41f4-9db9-be64e6ca3ec8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:39.266477 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-7596f520-396f-41f4-9db9-be64e6ca3ec8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:39.272646 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7596f520-396f-41f4-9db9-be64e6ca3ec8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:39.273127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7596f520-396f-41f4-9db9-be64e6ca3ec8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:39.273565 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7596f520-396f-41f4-9db9-be64e6ca3ec8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:39.274336 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7596f520-396f-41f4-9db9-be64e6ca3ec8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:39.274712 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7596f520-396f-41f4-9db9-be64e6ca3ec8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:39.275183 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7596f520-396f-41f4-9db9-be64e6ca3ec8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:39.412264 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7596f520-396f-41f4-9db9-be64e6ca3ec8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:39.420445 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-7596f520-396f-41f4-9db9-be64e6ca3ec8 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1522 microversion: 2.1 time: 0.159285 Oct 04 03:34:39.421021 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 326/658] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:39 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:39.566468 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6146e498-0f3c-424f-a9e8-24e8a5459dd9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:39.567150 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6146e498-0f3c-424f-a9e8-24e8a5459dd9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:39.574122 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6146e498-0f3c-424f-a9e8-24e8a5459dd9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:39.574635 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6146e498-0f3c-424f-a9e8-24e8a5459dd9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:39.575144 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6146e498-0f3c-424f-a9e8-24e8a5459dd9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:39.575871 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6146e498-0f3c-424f-a9e8-24e8a5459dd9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:39.576324 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6146e498-0f3c-424f-a9e8-24e8a5459dd9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:39.576748 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6146e498-0f3c-424f-a9e8-24e8a5459dd9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:39.711196 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6146e498-0f3c-424f-a9e8-24e8a5459dd9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:39.719386 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6146e498-0f3c-424f-a9e8-24e8a5459dd9 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1367 microversion: 2.1 time: 0.158384 Oct 04 03:34:39.719989 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 333/659] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:39 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:39.903314 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-82095bbe-dbb0-43ae-b00c-7a24d9fb360d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:39.903834 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-82095bbe-dbb0-43ae-b00c-7a24d9fb360d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:39.905736 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:39.910900 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-82095bbe-dbb0-43ae-b00c-7a24d9fb360d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:39.911354 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-82095bbe-dbb0-43ae-b00c-7a24d9fb360d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:39.911805 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-82095bbe-dbb0-43ae-b00c-7a24d9fb360d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:39.912481 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-82095bbe-dbb0-43ae-b00c-7a24d9fb360d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:39.912922 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-82095bbe-dbb0-43ae-b00c-7a24d9fb360d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:39.913334 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-82095bbe-dbb0-43ae-b00c-7a24d9fb360d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:39.950088 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-82095bbe-dbb0-43ae-b00c-7a24d9fb360d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d/ips" status: 200 len: 150 microversion: 2.20 time: 0.162476 Oct 04 03:34:39.950634 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 327/660] 10.222.0.25 () {60 vars in 1289 bytes} [Tue Oct 4 03:34:39 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d/ips => generated 150 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:34:40.444174 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bb161467-e060-4818-9548-a05e70874355 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:40.444795 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bb161467-e060-4818-9548-a05e70874355 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:40.450709 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb161467-e060-4818-9548-a05e70874355 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:40.451258 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb161467-e060-4818-9548-a05e70874355 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:40.451723 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb161467-e060-4818-9548-a05e70874355 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:40.452441 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb161467-e060-4818-9548-a05e70874355 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:40.452888 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb161467-e060-4818-9548-a05e70874355 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:40.453303 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb161467-e060-4818-9548-a05e70874355 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:40.581240 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-bb161467-e060-4818-9548-a05e70874355 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a267cf7109c64f538824c162fedd084b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62fd4925f3840edb9806630cd78c9fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:40.591854 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bb161467-e060-4818-9548-a05e70874355 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 200 len: 1480 microversion: 2.1 time: 0.151811 Oct 04 03:34:40.592965 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 334/661] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:40 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 1480 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:40.620991 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-b9383eb2-0b23-4ade-b01f-a2a3da4722c4 req-7c2c28a0-5c71-4933-9ca8-e53bb44531dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05277cf6-48c9-4eba-ae7a-4c7023431f1e", "name": "network-vif-deleted", "tag": "cee800ae-bdb3-403b-8297-cfe1d229c9e0"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:40.639666 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-b9383eb2-0b23-4ade-b01f-a2a3da4722c4 req-7c2c28a0-5c71-4933-9ca8-e53bb44531dd service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:40.640410 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-b9383eb2-0b23-4ade-b01f-a2a3da4722c4 req-7c2c28a0-5c71-4933-9ca8-e53bb44531dd service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:40.640922 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-b9383eb2-0b23-4ade-b01f-a2a3da4722c4 req-7c2c28a0-5c71-4933-9ca8-e53bb44531dd service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:40.657685 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-b9383eb2-0b23-4ade-b01f-a2a3da4722c4 req-7c2c28a0-5c71-4933-9ca8-e53bb44531dd service nova] Creating event network-vif-deleted:cee800ae-bdb3-403b-8297-cfe1d229c9e0 for instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e on hv-cinder-84914 Oct 04 03:34:40.662531 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-b9383eb2-0b23-4ade-b01f-a2a3da4722c4 req-7c2c28a0-5c71-4933-9ca8-e53bb44531dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045743 Oct 04 03:34:40.663207 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 328/662] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:40.741661 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-51442a62-dbc3-4383-858e-a3e568a5b011 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:40.742264 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-51442a62-dbc3-4383-858e-a3e568a5b011 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:40.748914 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51442a62-dbc3-4383-858e-a3e568a5b011 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:40.749748 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51442a62-dbc3-4383-858e-a3e568a5b011 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:40.750287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51442a62-dbc3-4383-858e-a3e568a5b011 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:40.751090 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51442a62-dbc3-4383-858e-a3e568a5b011 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:40.752194 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51442a62-dbc3-4383-858e-a3e568a5b011 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:40.752323 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51442a62-dbc3-4383-858e-a3e568a5b011 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:41.181546 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-51442a62-dbc3-4383-858e-a3e568a5b011 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:41.189067 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-51442a62-dbc3-4383-858e-a3e568a5b011 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1367 microversion: 2.1 time: 0.451344 Oct 04 03:34:41.189623 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 335/663] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:40 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1367 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:41.613336 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:41.614084 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=6 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:41.618991 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-fc8e9f17-ac57-45d5-bb4e-11b38604fe56 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:41.619706 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-fc8e9f17-ac57-45d5-bb4e-11b38604fe56 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] [instance: 05277cf6-48c9-4eba-ae7a-4c7023431f1e] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:41.626549 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fc8e9f17-ac57-45d5-bb4e-11b38604fe56 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:41.627102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fc8e9f17-ac57-45d5-bb4e-11b38604fe56 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:41.627434 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fc8e9f17-ac57-45d5-bb4e-11b38604fe56 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:41.628131 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fc8e9f17-ac57-45d5-bb4e-11b38604fe56 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:41.628573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fc8e9f17-ac57-45d5-bb4e-11b38604fe56 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:41.628986 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-fc8e9f17-ac57-45d5-bb4e-11b38604fe56 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:41.643401 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-fc8e9f17-ac57-45d5-bb4e-11b38604fe56 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] HTTP exception thrown: Instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e could not be found. Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-fc8e9f17-ac57-45d5-bb4e-11b38604fe56 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Request method failure captured: Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e HTTP/1.1 Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6iuldyrIBbW0f73v2K7ATYrextCGz2-_Yc58_h0cv-5TQFrImJgI3vgI3ryyGo9OGTifdm0w3ZapIKJj0Fj0su00BfHCMYaElTS2T4ES-IzJv9KifpjH3rp-cobaqB4aXjivbFQVaV2D5PTfUOLh5YQ34ZK3qeegc9sqNgzArwYGQ4 Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: b62fd4925f3840edb9806630cd78c9fa Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:34:41.645103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:34:41.646610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b62fd4925f3840edb9806630cd78c9fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b62fd4925f3840edb9806630cd78c9fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b62fd4925f3840edb9806630cd78c9fa", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b62fd4925f3840edb9806630cd78c9fa"}]}] Oct 04 03:34:41.646610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:34:41.646610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: b62fd4925f3840edb9806630cd78c9fa Oct 04 03:34:41.646610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-465130473 Oct 04 03:34:41.646610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-ServerRescueNegativeTestJSON-465130473-project Oct 04 03:34:41.646610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:34:41.646610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:34:41.646610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: a267cf7109c64f538824c162fedd084b Oct 04 03:34:41.646610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-465130473-project Oct 04 03:34:41.646610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:34:41.646610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e could not be found. Oct 04 03:34:41.646610 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '05277cf6-48c9-4eba-ae7a-4c7023431f1e'} Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e could not be found. Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:34:41.647437 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e could not be found. Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e could not be found. Oct 04 03:34:41.648815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:34:41.650510 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-fc8e9f17-ac57-45d5-bb4e-11b38604fe56 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] Returning 404 to user: Instance 05277cf6-48c9-4eba-ae7a-4c7023431f1e could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:34:41.650510 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-fc8e9f17-ac57-45d5-bb4e-11b38604fe56 tempest-ServerRescueNegativeTestJSON-465130473 tempest-ServerRescueNegativeTestJSON-465130473-project] 10.222.0.25 "GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e" status: 404 len: 111 microversion: 2.1 time: 0.034116 Oct 04 03:34:41.650510 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 329/664] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:41 2022] GET /compute/v2.1/servers/05277cf6-48c9-4eba-ae7a-4c7023431f1e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:34:41.834823 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e2c4b89e-0d6a-4324-bcd3-103ff2b8f7a8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:41.836092 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e2c4b89e-0d6a-4324-bcd3-103ff2b8f7a8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:41.838401 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:41.844249 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2c4b89e-0d6a-4324-bcd3-103ff2b8f7a8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:41.844733 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2c4b89e-0d6a-4324-bcd3-103ff2b8f7a8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:41.845217 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2c4b89e-0d6a-4324-bcd3-103ff2b8f7a8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:41.845861 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2c4b89e-0d6a-4324-bcd3-103ff2b8f7a8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:41.846308 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2c4b89e-0d6a-4324-bcd3-103ff2b8f7a8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:41.846728 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e2c4b89e-0d6a-4324-bcd3-103ff2b8f7a8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:41.871396 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-e2c4b89e-0d6a-4324-bcd3-103ff2b8f7a8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lazy-loading 'flavor' on Instance uuid 8528cda6-7d7e-4973-b37c-bcfccbd9351d {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:34:42.060532 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e2c4b89e-0d6a-4324-bcd3-103ff2b8f7a8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "POST /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d/action" status: 202 len: 0 microversion: 2.20 time: 0.229967 Oct 04 03:34:42.061421 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 336/665] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Oct 4 03:34:41 2022] POST /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:34:42.069683 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-91f9edb8-6eff-47ee-8818-d4a0ea8de57f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:42.070295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-91f9edb8-6eff-47ee-8818-d4a0ea8de57f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:42.077016 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91f9edb8-6eff-47ee-8818-d4a0ea8de57f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:42.077371 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91f9edb8-6eff-47ee-8818-d4a0ea8de57f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:42.077813 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91f9edb8-6eff-47ee-8818-d4a0ea8de57f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:42.078510 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91f9edb8-6eff-47ee-8818-d4a0ea8de57f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:42.078963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91f9edb8-6eff-47ee-8818-d4a0ea8de57f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:42.079391 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91f9edb8-6eff-47ee-8818-d4a0ea8de57f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:42.210850 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-91f9edb8-6eff-47ee-8818-d4a0ea8de57f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:42.214852 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-16bb8d15-c4c4-460f-9c76-20303722de08 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:42.215575 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-16bb8d15-c4c4-460f-9c76-20303722de08 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:42.220723 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-91f9edb8-6eff-47ee-8818-d4a0ea8de57f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:42.221799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16bb8d15-c4c4-460f-9c76-20303722de08 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:42.222283 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16bb8d15-c4c4-460f-9c76-20303722de08 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:42.222709 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16bb8d15-c4c4-460f-9c76-20303722de08 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:42.222829 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-91f9edb8-6eff-47ee-8818-d4a0ea8de57f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:42.223532 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16bb8d15-c4c4-460f-9c76-20303722de08 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:42.223864 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16bb8d15-c4c4-460f-9c76-20303722de08 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:42.224276 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16bb8d15-c4c4-460f-9c76-20303722de08 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:42.224690 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-91f9edb8-6eff-47ee-8818-d4a0ea8de57f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.159108 Oct 04 03:34:42.225438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 330/666] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:42 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:34:42.367097 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-16bb8d15-c4c4-460f-9c76-20303722de08 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:42.376923 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-16bb8d15-c4c4-460f-9c76-20303722de08 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1367 microversion: 2.1 time: 0.167601 Oct 04 03:34:42.377997 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 337/667] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:42 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:34:43.250214 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-79ce242a-6d31-455e-937f-35e1dfe2444f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:43.250947 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-79ce242a-6d31-455e-937f-35e1dfe2444f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:43.257337 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79ce242a-6d31-455e-937f-35e1dfe2444f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:43.257812 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79ce242a-6d31-455e-937f-35e1dfe2444f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:43.258240 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79ce242a-6d31-455e-937f-35e1dfe2444f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:43.259506 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79ce242a-6d31-455e-937f-35e1dfe2444f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:43.259954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79ce242a-6d31-455e-937f-35e1dfe2444f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:43.260371 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-79ce242a-6d31-455e-937f-35e1dfe2444f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:43.390621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-79ce242a-6d31-455e-937f-35e1dfe2444f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:43.402324 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5b1836c8-406c-46ff-b3d4-d2798e18b64e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:43.403075 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5b1836c8-406c-46ff-b3d4-d2798e18b64e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:43.407121 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-79ce242a-6d31-455e-937f-35e1dfe2444f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:43.408616 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-79ce242a-6d31-455e-937f-35e1dfe2444f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:43.409777 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b1836c8-406c-46ff-b3d4-d2798e18b64e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:43.409932 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-79ce242a-6d31-455e-937f-35e1dfe2444f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.163521 Oct 04 03:34:43.410256 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b1836c8-406c-46ff-b3d4-d2798e18b64e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:43.410681 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b1836c8-406c-46ff-b3d4-d2798e18b64e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:43.411566 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b1836c8-406c-46ff-b3d4-d2798e18b64e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:43.412210 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b1836c8-406c-46ff-b3d4-d2798e18b64e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:43.412792 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b1836c8-406c-46ff-b3d4-d2798e18b64e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:43.419709 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 331/668] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:43 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:34:43.549067 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5b1836c8-406c-46ff-b3d4-d2798e18b64e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:43.557354 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5b1836c8-406c-46ff-b3d4-d2798e18b64e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1367 microversion: 2.1 time: 0.159920 Oct 04 03:34:43.557923 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 338/669] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:43 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:34:44.437746 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6f6bb2e9-0ba1-4412-9b2f-6a7259c195b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:44.440010 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6f6bb2e9-0ba1-4412-9b2f-6a7259c195b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:44.449744 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6f6bb2e9-0ba1-4412-9b2f-6a7259c195b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:44.450560 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6f6bb2e9-0ba1-4412-9b2f-6a7259c195b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:44.451193 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6f6bb2e9-0ba1-4412-9b2f-6a7259c195b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:44.452142 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6f6bb2e9-0ba1-4412-9b2f-6a7259c195b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:44.453412 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6f6bb2e9-0ba1-4412-9b2f-6a7259c195b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:44.453845 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6f6bb2e9-0ba1-4412-9b2f-6a7259c195b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:44.549308 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-e0ea6d8b-bd52-4bef-bc26-cd1b3952b2b8 req-4d388968-d997-45d3-9566-817d764a90da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d704ae4-024f-4f05-8c08-2853b755b031", "name": "network-vif-plugged", "status": "completed", "tag": "972122cd-e121-416b-a905-f6ab52c59458"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:44.562229 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-e0ea6d8b-bd52-4bef-bc26-cd1b3952b2b8 req-4d388968-d997-45d3-9566-817d764a90da service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:44.562983 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-e0ea6d8b-bd52-4bef-bc26-cd1b3952b2b8 req-4d388968-d997-45d3-9566-817d764a90da service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:44.563735 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-e0ea6d8b-bd52-4bef-bc26-cd1b3952b2b8 req-4d388968-d997-45d3-9566-817d764a90da service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:44.579767 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-e0ea6d8b-bd52-4bef-bc26-cd1b3952b2b8 req-4d388968-d997-45d3-9566-817d764a90da service nova] Creating event network-vif-plugged:972122cd-e121-416b-a905-f6ab52c59458 for instance 4d704ae4-024f-4f05-8c08-2853b755b031 on hv-cinder-84914 Oct 04 03:34:44.591033 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-e0ea6d8b-bd52-4bef-bc26-cd1b3952b2b8 req-4d388968-d997-45d3-9566-817d764a90da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046320 Oct 04 03:34:44.593357 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 339/670] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:34:44.599385 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bf3265d2-8e94-426e-a7ee-0ac29412210e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:44.600561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bf3265d2-8e94-426e-a7ee-0ac29412210e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:44.620506 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf3265d2-8e94-426e-a7ee-0ac29412210e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:44.621361 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf3265d2-8e94-426e-a7ee-0ac29412210e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:44.621946 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf3265d2-8e94-426e-a7ee-0ac29412210e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:44.622911 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf3265d2-8e94-426e-a7ee-0ac29412210e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:44.623529 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf3265d2-8e94-426e-a7ee-0ac29412210e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:44.624102 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf3265d2-8e94-426e-a7ee-0ac29412210e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:44.642133 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6f6bb2e9-0ba1-4412-9b2f-6a7259c195b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:44.654897 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6f6bb2e9-0ba1-4412-9b2f-6a7259c195b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:44.656830 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6f6bb2e9-0ba1-4412-9b2f-6a7259c195b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:44.659937 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6f6bb2e9-0ba1-4412-9b2f-6a7259c195b1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.225616 Oct 04 03:34:44.661644 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 332/671] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:44 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:34:44.899420 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-bf3265d2-8e94-426e-a7ee-0ac29412210e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:44.908254 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bf3265d2-8e94-426e-a7ee-0ac29412210e tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1367 microversion: 2.1 time: 0.313055 Oct 04 03:34:44.909505 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 340/672] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:44 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:45.686907 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-394caa27-2094-4a6c-abd8-a566150142ae tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:45.687835 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-394caa27-2094-4a6c-abd8-a566150142ae tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:45.696754 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-394caa27-2094-4a6c-abd8-a566150142ae tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:45.697347 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-394caa27-2094-4a6c-abd8-a566150142ae tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:45.697892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-394caa27-2094-4a6c-abd8-a566150142ae tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:45.698786 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-394caa27-2094-4a6c-abd8-a566150142ae tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:45.699557 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-394caa27-2094-4a6c-abd8-a566150142ae tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:45.700172 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-394caa27-2094-4a6c-abd8-a566150142ae tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:45.840779 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-394caa27-2094-4a6c-abd8-a566150142ae tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:45.849009 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-394caa27-2094-4a6c-abd8-a566150142ae tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:45.850450 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-394caa27-2094-4a6c-abd8-a566150142ae tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:45.851666 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-394caa27-2094-4a6c-abd8-a566150142ae tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.168965 Oct 04 03:34:45.852291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 333/673] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:45 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:34:45.935833 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ae898178-a20a-4bf9-89b8-469edfdb3e4c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:45.936423 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ae898178-a20a-4bf9-89b8-469edfdb3e4c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:45.942846 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae898178-a20a-4bf9-89b8-469edfdb3e4c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:45.943322 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae898178-a20a-4bf9-89b8-469edfdb3e4c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:45.944029 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae898178-a20a-4bf9-89b8-469edfdb3e4c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:45.944708 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae898178-a20a-4bf9-89b8-469edfdb3e4c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:45.945152 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae898178-a20a-4bf9-89b8-469edfdb3e4c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:45.945568 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae898178-a20a-4bf9-89b8-469edfdb3e4c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:46.087631 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ae898178-a20a-4bf9-89b8-469edfdb3e4c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:46.096211 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ae898178-a20a-4bf9-89b8-469edfdb3e4c tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1367 microversion: 2.1 time: 0.164249 Oct 04 03:34:46.096739 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 341/674] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:45 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:46.325997 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-19b75b32-86bc-4073-9751-4fdd54210f33 tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] Action: 'create', calling method: .version_select at 0x7f165b419160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-591911462", "metadata": {"Type": "work"}}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:46.614479 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-19b75b32-86bc-4073-9751-4fdd54210f33 tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.399872 Oct 04 03:34:46.615109 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 334/675] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Oct 4 03:34:46 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 401 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 03:34:46.628589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c18132d7-9da1-4057-947e-70ba455daf7a tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] Calling method '.version_select at 0x7f165b37e430>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:46.678379 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c18132d7-9da1-4057-947e-70ba455daf7a tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc" status: 200 len: 352 microversion: 2.1 time: 0.053491 Oct 04 03:34:46.679048 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 342/676] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Oct 4 03:34:46 2022] GET /compute/v2.1/os-volumes/8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:46.878895 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c4a7beda-094b-4d8b-8ee3-86267a510bb6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:46.879507 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c4a7beda-094b-4d8b-8ee3-86267a510bb6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:46.886137 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c4a7beda-094b-4d8b-8ee3-86267a510bb6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:46.886615 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c4a7beda-094b-4d8b-8ee3-86267a510bb6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:46.887044 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c4a7beda-094b-4d8b-8ee3-86267a510bb6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:46.887752 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c4a7beda-094b-4d8b-8ee3-86267a510bb6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:46.888223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c4a7beda-094b-4d8b-8ee3-86267a510bb6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:46.888643 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c4a7beda-094b-4d8b-8ee3-86267a510bb6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:47.028442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c4a7beda-094b-4d8b-8ee3-86267a510bb6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:47.039266 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c4a7beda-094b-4d8b-8ee3-86267a510bb6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:47.043052 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c4a7beda-094b-4d8b-8ee3-86267a510bb6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:47.045633 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c4a7beda-094b-4d8b-8ee3-86267a510bb6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.170047 Oct 04 03:34:47.046221 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 335/677] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:46 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:34:47.120413 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5400e92a-fad7-4945-ad2f-ec19f497365a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:47.121013 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5400e92a-fad7-4945-ad2f-ec19f497365a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:47.126947 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5400e92a-fad7-4945-ad2f-ec19f497365a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:47.127420 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5400e92a-fad7-4945-ad2f-ec19f497365a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:47.127874 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5400e92a-fad7-4945-ad2f-ec19f497365a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:47.128552 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5400e92a-fad7-4945-ad2f-ec19f497365a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:47.128995 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5400e92a-fad7-4945-ad2f-ec19f497365a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:47.129409 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5400e92a-fad7-4945-ad2f-ec19f497365a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:47.257683 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5400e92a-fad7-4945-ad2f-ec19f497365a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:47.265870 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5400e92a-fad7-4945-ad2f-ec19f497365a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1557 microversion: 2.1 time: 0.149890 Oct 04 03:34:47.266430 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 343/678] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:34:47 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:34:47.288293 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-19ef1b05-3fef-449e-bf21-87061173a6cb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:47.288778 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-19ef1b05-3fef-449e-bf21-87061173a6cb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:47.294659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-19ef1b05-3fef-449e-bf21-87061173a6cb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:47.295128 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-19ef1b05-3fef-449e-bf21-87061173a6cb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:47.295582 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-19ef1b05-3fef-449e-bf21-87061173a6cb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:47.296254 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-19ef1b05-3fef-449e-bf21-87061173a6cb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:47.296698 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-19ef1b05-3fef-449e-bf21-87061173a6cb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:47.297111 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-19ef1b05-3fef-449e-bf21-87061173a6cb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:47.299374 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:47.380705 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-19ef1b05-3fef-449e-bf21-87061173a6cb tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096254 Oct 04 03:34:47.381296 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 336/679] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Oct 4 03:34:47 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:47.694181 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d8fd35fd-96f1-4d19-a8a4-badbf8266e95 tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] Calling method '.version_select at 0x7f165b37e550>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:47.746051 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d8fd35fd-96f1-4d19-a8a4-badbf8266e95 tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc" status: 200 len: 353 microversion: 2.1 time: 0.056484 Oct 04 03:34:47.746750 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 344/680] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Oct 4 03:34:47 2022] GET /compute/v2.1/os-volumes/8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:47.760303 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-4675561a-eb06-4863-a2a5-311478ad29de tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] Calling method '.version_select at 0x7f165b3e1e50>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:47.808419 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-4675561a-eb06-4863-a2a5-311478ad29de tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc" status: 200 len: 353 microversion: 2.1 time: 0.052854 Oct 04 03:34:47.808990 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 337/681] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Oct 4 03:34:47 2022] GET /compute/v2.1/os-volumes/8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:47.827688 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3c1b81c2-a4bf-406a-bc2a-e24c42708ae0 tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] Calling method '.version_select at 0x7f165b3d9c10>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:47.889222 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3c1b81c2-a4bf-406a-bc2a-e24c42708ae0 tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc" status: 202 len: 0 microversion: 2.1 time: 0.065260 Oct 04 03:34:47.889785 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 345/682] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Oct 4 03:34:47 2022] DELETE /compute/v2.1/os-volumes/8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:34:47.898919 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0d126ce0-bec6-49ab-901a-245a99b062bd tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] Calling method '.version_select at 0x7f165b3cf670>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:47.949888 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0d126ce0-bec6-49ab-901a-245a99b062bd tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc" status: 200 len: 352 microversion: 2.1 time: 0.055210 Oct 04 03:34:47.950632 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 338/683] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Oct 4 03:34:47 2022] GET /compute/v2.1/os-volumes/8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:48.071990 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ac45c916-9e1d-485e-91d3-2f9ea3e9050f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:48.072595 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ac45c916-9e1d-485e-91d3-2f9ea3e9050f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:48.079162 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ac45c916-9e1d-485e-91d3-2f9ea3e9050f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:48.079670 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ac45c916-9e1d-485e-91d3-2f9ea3e9050f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:48.080112 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ac45c916-9e1d-485e-91d3-2f9ea3e9050f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:48.080825 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ac45c916-9e1d-485e-91d3-2f9ea3e9050f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:48.081269 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ac45c916-9e1d-485e-91d3-2f9ea3e9050f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:48.081683 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ac45c916-9e1d-485e-91d3-2f9ea3e9050f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:48.085795 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:48.296875 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ac45c916-9e1d-485e-91d3-2f9ea3e9050f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:48.304870 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ac45c916-9e1d-485e-91d3-2f9ea3e9050f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:48.306829 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ac45c916-9e1d-485e-91d3-2f9ea3e9050f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:48.308005 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ac45c916-9e1d-485e-91d3-2f9ea3e9050f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.241120 Oct 04 03:34:48.308555 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 346/684] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:48 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:34:48.394629 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-783ac070-828b-4f86-adb2-00dc84397204 req-8bebbafe-17fa-4fea-9857-94cb5078d5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d704ae4-024f-4f05-8c08-2853b755b031", "tag": "972122cd-e121-416b-a905-f6ab52c59458"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:48.405790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-783ac070-828b-4f86-adb2-00dc84397204 req-8bebbafe-17fa-4fea-9857-94cb5078d5ba service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:48.406265 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-783ac070-828b-4f86-adb2-00dc84397204 req-8bebbafe-17fa-4fea-9857-94cb5078d5ba service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:48.406695 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-783ac070-828b-4f86-adb2-00dc84397204 req-8bebbafe-17fa-4fea-9857-94cb5078d5ba service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:48.416860 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-783ac070-828b-4f86-adb2-00dc84397204 req-8bebbafe-17fa-4fea-9857-94cb5078d5ba service nova] Creating event network-changed:972122cd-e121-416b-a905-f6ab52c59458 for instance 4d704ae4-024f-4f05-8c08-2853b755b031 on hv-cinder-84914 Oct 04 03:34:48.422519 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-783ac070-828b-4f86-adb2-00dc84397204 req-8bebbafe-17fa-4fea-9857-94cb5078d5ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031123 Oct 04 03:34:48.423162 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 339/685] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:48.967073 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c5c6e3fe-605a-4d5b-b262-92a0aa17a0aa tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] Calling method '.version_select at 0x7f165b3d9d30>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:48.996797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-c5c6e3fe-605a-4d5b-b262-92a0aa17a0aa tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] HTTP exception thrown: Volume 8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc could not be found. Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c5c6e3fe-605a-4d5b-b262-92a0aa17a0aa tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] Request method failure captured: Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/os-volumes/8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc HTTP/1.1 Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6nWUwfHVDsLi7ZyMBcQhy_j6cn5ERCyxp_Het4PMe6nlfZe7nVJlO5z6k3lNo4d-MalACVwLYNVSbwLUbReIVZKEB5kUIx9fE_0eG33N9LuqeFnJKRyAa1fyPfYlGDdWUDxjvb0vFeW62cYmnr3CCQezP1Y-wBI5r2DdZCHOhhuTE0 Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: 9491732700c94ee28598bbe7e38780b9 Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-VolumesGetTestJSON-468021275 Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:34:48.999068 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:34:49.000678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9491732700c94ee28598bbe7e38780b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9491732700c94ee28598bbe7e38780b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9491732700c94ee28598bbe7e38780b9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9491732700c94ee28598bbe7e38780b9"}]}] Oct 04 03:34:49.000678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-VolumesGetTestJSON-468021275 Oct 04 03:34:49.000678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: 9491732700c94ee28598bbe7e38780b9 Oct 04 03:34:49.000678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-VolumesGetTestJSON-468021275 Oct 04 03:34:49.000678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-VolumesGetTestJSON-468021275-project Oct 04 03:34:49.000678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:34:49.000678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:34:49.000678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: 19d8b6cf60d84abe893799d0bbcc23d1 Oct 04 03:34:49.000678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-VolumesGetTestJSON-468021275-project Oct 04 03:34:49.000678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: Oct 04 03:34:49.000678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Volume 8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc could not be found. Oct 04 03:34:49.000678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc'} Oct 04 03:34:49.000678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc could not be found. (HTTP 404) (Request-ID: req-50522adc-c5be-454a-8aac-d20d7fad2121) Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:49.001541 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 03:34:49.002716 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc could not be found. Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 03:34:49.004001 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:34:49.005571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc could not be found. Oct 04 03:34:49.005571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:49.005571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:34:49.005571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:49.005571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:34:49.005571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:34:49.005571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:34:49.005571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:34:49.005571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:34:49.005571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc could not be found. Oct 04 03:34:49.005571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:34:49.005571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c5c6e3fe-605a-4d5b-b262-92a0aa17a0aa tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] Returning 404 to user: Volume 8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:34:49.005571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c5c6e3fe-605a-4d5b-b262-92a0aa17a0aa tempest-VolumesGetTestJSON-468021275 tempest-VolumesGetTestJSON-468021275-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc" status: 404 len: 109 microversion: 2.1 time: 0.037446 Oct 04 03:34:49.005571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 347/686] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Oct 4 03:34:48 2022] GET /compute/v2.1/os-volumes/8dbc20b8-4680-4d60-bffb-2a8c24d9f6bc => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:34:49.334791 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-34e396f9-9360-4655-be0a-fb14d53322e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:49.335519 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-34e396f9-9360-4655-be0a-fb14d53322e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:49.343779 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-34e396f9-9360-4655-be0a-fb14d53322e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:49.344454 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-34e396f9-9360-4655-be0a-fb14d53322e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:49.344892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-34e396f9-9360-4655-be0a-fb14d53322e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:49.345668 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-34e396f9-9360-4655-be0a-fb14d53322e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:49.346034 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-34e396f9-9360-4655-be0a-fb14d53322e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:49.346458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-34e396f9-9360-4655-be0a-fb14d53322e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:49.532392 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-34e396f9-9360-4655-be0a-fb14d53322e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:49.542911 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-34e396f9-9360-4655-be0a-fb14d53322e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:49.544716 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-34e396f9-9360-4655-be0a-fb14d53322e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:49.545970 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-34e396f9-9360-4655-be0a-fb14d53322e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.215569 Oct 04 03:34:49.546607 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 340/687] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:49 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:34:50.574494 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7cd8ac8c-815a-4d28-aac1-fed69c5284fa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:50.575125 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7cd8ac8c-815a-4d28-aac1-fed69c5284fa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:50.582142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7cd8ac8c-815a-4d28-aac1-fed69c5284fa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:50.582633 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7cd8ac8c-815a-4d28-aac1-fed69c5284fa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:50.583063 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7cd8ac8c-815a-4d28-aac1-fed69c5284fa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:50.583785 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7cd8ac8c-815a-4d28-aac1-fed69c5284fa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:50.584234 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7cd8ac8c-815a-4d28-aac1-fed69c5284fa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:50.584655 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7cd8ac8c-815a-4d28-aac1-fed69c5284fa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:50.719574 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-7cd8ac8c-815a-4d28-aac1-fed69c5284fa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:50.737474 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-7cd8ac8c-815a-4d28-aac1-fed69c5284fa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:50.739022 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-7cd8ac8c-815a-4d28-aac1-fed69c5284fa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:50.740575 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7cd8ac8c-815a-4d28-aac1-fed69c5284fa tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.170907 Oct 04 03:34:50.741122 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 348/688] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:50 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:34:51.766642 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-ce275845-bb61-477a-b715-f160aa46e6d0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:51.767182 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-ce275845-bb61-477a-b715-f160aa46e6d0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:51.774565 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ce275845-bb61-477a-b715-f160aa46e6d0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:51.775069 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ce275845-bb61-477a-b715-f160aa46e6d0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:51.775513 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ce275845-bb61-477a-b715-f160aa46e6d0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:51.776204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ce275845-bb61-477a-b715-f160aa46e6d0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:51.776651 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ce275845-bb61-477a-b715-f160aa46e6d0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:51.777070 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ce275845-bb61-477a-b715-f160aa46e6d0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:51.912209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-ce275845-bb61-477a-b715-f160aa46e6d0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:51.921244 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-ce275845-bb61-477a-b715-f160aa46e6d0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:51.922657 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-ce275845-bb61-477a-b715-f160aa46e6d0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:51.923816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-ce275845-bb61-477a-b715-f160aa46e6d0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.161104 Oct 04 03:34:51.924366 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 341/689] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:51 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:34:52.949792 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9c826112-034a-4679-81c5-f962ef4c928d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:52.950443 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-9c826112-034a-4679-81c5-f962ef4c928d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:52.956543 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c826112-034a-4679-81c5-f962ef4c928d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:52.957018 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c826112-034a-4679-81c5-f962ef4c928d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:52.957442 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c826112-034a-4679-81c5-f962ef4c928d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:52.958121 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c826112-034a-4679-81c5-f962ef4c928d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:52.958562 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c826112-034a-4679-81c5-f962ef4c928d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:52.958984 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c826112-034a-4679-81c5-f962ef4c928d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:53.072075 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1eb6fa70-9b86-4419-a5bd-e0be68c2b3a7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:53.072603 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1eb6fa70-9b86-4419-a5bd-e0be68c2b3a7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:53.074506 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:53.080106 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1eb6fa70-9b86-4419-a5bd-e0be68c2b3a7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:53.080584 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1eb6fa70-9b86-4419-a5bd-e0be68c2b3a7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:53.081013 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1eb6fa70-9b86-4419-a5bd-e0be68c2b3a7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:53.081700 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1eb6fa70-9b86-4419-a5bd-e0be68c2b3a7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:53.082141 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1eb6fa70-9b86-4419-a5bd-e0be68c2b3a7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:53.082555 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1eb6fa70-9b86-4419-a5bd-e0be68c2b3a7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:53.094307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-9c826112-034a-4679-81c5-f962ef4c928d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:53.102572 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-9c826112-034a-4679-81c5-f962ef4c928d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:53.104067 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-9c826112-034a-4679-81c5-f962ef4c928d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:53.105232 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-9c826112-034a-4679-81c5-f962ef4c928d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.159759 Oct 04 03:34:53.105802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 342/690] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:52 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:34:53.109752 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1eb6fa70-9b86-4419-a5bd-e0be68c2b3a7 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/ips" status: 200 len: 147 microversion: 2.1 time: 0.217493 Oct 04 03:34:53.110477 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 349/691] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Oct 4 03:34:52 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/ips => generated 147 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:54.131574 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0aaf5d27-0505-46e4-8572-89beee4f6f36 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:54.132175 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-0aaf5d27-0505-46e4-8572-89beee4f6f36 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:54.139294 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0aaf5d27-0505-46e4-8572-89beee4f6f36 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:54.139802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0aaf5d27-0505-46e4-8572-89beee4f6f36 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:54.140231 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0aaf5d27-0505-46e4-8572-89beee4f6f36 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:54.140910 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0aaf5d27-0505-46e4-8572-89beee4f6f36 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:54.141364 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0aaf5d27-0505-46e4-8572-89beee4f6f36 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:54.141765 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0aaf5d27-0505-46e4-8572-89beee4f6f36 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:54.282232 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0aaf5d27-0505-46e4-8572-89beee4f6f36 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:54.290736 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0aaf5d27-0505-46e4-8572-89beee4f6f36 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:54.292205 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0aaf5d27-0505-46e4-8572-89beee4f6f36 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:54.293355 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0aaf5d27-0505-46e4-8572-89beee4f6f36 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.165733 Oct 04 03:34:54.294134 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 343/692] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:54 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:34:54.439777 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fb42bcc6-aa6c-465a-ac4d-f14a0f3ae075 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71c202ea-1292-4a6a-bda5-1e2d4f157e43"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:54.442199 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-fb42bcc6-aa6c-465a-ac4d-f14a0f3ae075 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:54.449233 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fb42bcc6-aa6c-465a-ac4d-f14a0f3ae075 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:54.449721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fb42bcc6-aa6c-465a-ac4d-f14a0f3ae075 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:54.450142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fb42bcc6-aa6c-465a-ac4d-f14a0f3ae075 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:54.450836 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fb42bcc6-aa6c-465a-ac4d-f14a0f3ae075 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:54.451280 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fb42bcc6-aa6c-465a-ac4d-f14a0f3ae075 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:54.451723 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fb42bcc6-aa6c-465a-ac4d-f14a0f3ae075 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:54.713845 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-fb42bcc6-aa6c-465a-ac4d-f14a0f3ae075 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "POST /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274899 Oct 04 03:34:54.713845 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 350/693] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Oct 4 03:34:54 2022] POST /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:55.319499 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b0b04198-ac09-4743-8cb5-55a1306a578f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:55.320131 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b0b04198-ac09-4743-8cb5-55a1306a578f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:55.327296 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0b04198-ac09-4743-8cb5-55a1306a578f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:55.327826 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0b04198-ac09-4743-8cb5-55a1306a578f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:55.328289 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0b04198-ac09-4743-8cb5-55a1306a578f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:55.328982 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0b04198-ac09-4743-8cb5-55a1306a578f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:55.329440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0b04198-ac09-4743-8cb5-55a1306a578f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:55.329865 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0b04198-ac09-4743-8cb5-55a1306a578f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:55.459823 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b0b04198-ac09-4743-8cb5-55a1306a578f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:55.468511 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b0b04198-ac09-4743-8cb5-55a1306a578f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:55.469950 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b0b04198-ac09-4743-8cb5-55a1306a578f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:55.471108 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b0b04198-ac09-4743-8cb5-55a1306a578f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.155947 Oct 04 03:34:55.471702 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 344/694] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:55 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:34:55.916236 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-eb63225f-2608-4b54-83e8-c2ff758da46c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:55.918748 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-eb63225f-2608-4b54-83e8-c2ff758da46c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:55.926084 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eb63225f-2608-4b54-83e8-c2ff758da46c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:55.926577 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eb63225f-2608-4b54-83e8-c2ff758da46c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:55.927142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eb63225f-2608-4b54-83e8-c2ff758da46c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:55.927883 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eb63225f-2608-4b54-83e8-c2ff758da46c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:55.928325 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eb63225f-2608-4b54-83e8-c2ff758da46c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:55.928748 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eb63225f-2608-4b54-83e8-c2ff758da46c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:55.961257 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-eb63225f-2608-4b54-83e8-c2ff758da46c tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051701 Oct 04 03:34:55.961927 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 351/695] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:34:55 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:55.978006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-48fbf217-7c7d-442b-bc89-441b22607549 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:55.978510 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-48fbf217-7c7d-442b-bc89-441b22607549 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:55.986431 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48fbf217-7c7d-442b-bc89-441b22607549 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:55.987175 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48fbf217-7c7d-442b-bc89-441b22607549 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:55.987862 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48fbf217-7c7d-442b-bc89-441b22607549 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:55.988590 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48fbf217-7c7d-442b-bc89-441b22607549 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:55.989076 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48fbf217-7c7d-442b-bc89-441b22607549 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:55.989525 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48fbf217-7c7d-442b-bc89-441b22607549 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:56.021315 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-48fbf217-7c7d-442b-bc89-441b22607549 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments/71c202ea-1292-4a6a-bda5-1e2d4f157e43" status: 200 len: 194 microversion: 2.1 time: 0.051547 Oct 04 03:34:56.021768 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 345/696] 10.222.0.25 () {58 vars in 1413 bytes} [Tue Oct 4 03:34:55 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments/71c202ea-1292-4a6a-bda5-1e2d4f157e43 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:56.497544 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b78ba160-38f4-443d-8e80-77d35a7ba4e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:56.498146 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b78ba160-38f4-443d-8e80-77d35a7ba4e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:56.504778 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b78ba160-38f4-443d-8e80-77d35a7ba4e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:56.505254 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b78ba160-38f4-443d-8e80-77d35a7ba4e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:56.505678 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b78ba160-38f4-443d-8e80-77d35a7ba4e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:56.506354 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b78ba160-38f4-443d-8e80-77d35a7ba4e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:56.506797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b78ba160-38f4-443d-8e80-77d35a7ba4e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:56.507210 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b78ba160-38f4-443d-8e80-77d35a7ba4e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:56.638701 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b78ba160-38f4-443d-8e80-77d35a7ba4e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:56.646874 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b78ba160-38f4-443d-8e80-77d35a7ba4e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:56.648344 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b78ba160-38f4-443d-8e80-77d35a7ba4e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:56.649495 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b78ba160-38f4-443d-8e80-77d35a7ba4e9 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.156637 Oct 04 03:34:56.650051 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 352/697] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:56 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:34:57.364190 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d81fa779-ed52-444b-8914-4a4af72e1800 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6ddf36d-5ad9-406e-88fc-770a8a550d1e"}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:34:57.366661 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d81fa779-ed52-444b-8914-4a4af72e1800 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:57.374204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d81fa779-ed52-444b-8914-4a4af72e1800 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:57.374689 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d81fa779-ed52-444b-8914-4a4af72e1800 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:57.375120 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d81fa779-ed52-444b-8914-4a4af72e1800 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:57.375836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d81fa779-ed52-444b-8914-4a4af72e1800 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:57.376288 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d81fa779-ed52-444b-8914-4a4af72e1800 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:57.376716 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d81fa779-ed52-444b-8914-4a4af72e1800 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:57.630510 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d81fa779-ed52-444b-8914-4a4af72e1800 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "POST /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270078 Oct 04 03:34:57.631400 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 346/698] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Oct 4 03:34:57 2022] POST /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:34:57.678241 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6b5ea4d7-3f14-4983-bc60-17961dbd4eb8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:57.679374 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6b5ea4d7-3f14-4983-bc60-17961dbd4eb8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:57.692875 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b5ea4d7-3f14-4983-bc60-17961dbd4eb8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:57.696055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b5ea4d7-3f14-4983-bc60-17961dbd4eb8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:57.696942 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b5ea4d7-3f14-4983-bc60-17961dbd4eb8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:57.699405 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b5ea4d7-3f14-4983-bc60-17961dbd4eb8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:57.700587 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b5ea4d7-3f14-4983-bc60-17961dbd4eb8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:57.701206 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b5ea4d7-3f14-4983-bc60-17961dbd4eb8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:57.883777 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6b5ea4d7-3f14-4983-bc60-17961dbd4eb8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:57.893649 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6b5ea4d7-3f14-4983-bc60-17961dbd4eb8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:57.895297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6b5ea4d7-3f14-4983-bc60-17961dbd4eb8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:57.896476 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6b5ea4d7-3f14-4983-bc60-17961dbd4eb8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1742 microversion: 2.20 time: 0.223143 Oct 04 03:34:57.897208 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 353/699] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:57 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1742 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:34:58.923389 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e9dc553b-9a27-40cd-a72c-530157418da3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:58.924140 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e9dc553b-9a27-40cd-a72c-530157418da3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:58.930730 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e9dc553b-9a27-40cd-a72c-530157418da3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:58.931204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e9dc553b-9a27-40cd-a72c-530157418da3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:58.932314 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e9dc553b-9a27-40cd-a72c-530157418da3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:58.933131 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e9dc553b-9a27-40cd-a72c-530157418da3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:58.933630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e9dc553b-9a27-40cd-a72c-530157418da3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:58.934002 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e9dc553b-9a27-40cd-a72c-530157418da3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:59.075923 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e9dc553b-9a27-40cd-a72c-530157418da3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:59.094389 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e9dc553b-9a27-40cd-a72c-530157418da3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:59.096293 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e9dc553b-9a27-40cd-a72c-530157418da3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:34:59.097743 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e9dc553b-9a27-40cd-a72c-530157418da3 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1742 microversion: 2.20 time: 0.178523 Oct 04 03:34:59.098510 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 347/700] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:34:58 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:34:59.898852 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-79f83df6-135a-498c-8586-983096606251 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:34:59.901859 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-79f83df6-135a-498c-8586-983096606251 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:34:59.907926 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-79f83df6-135a-498c-8586-983096606251 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:59.908664 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-79f83df6-135a-498c-8586-983096606251 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:59.909034 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-79f83df6-135a-498c-8586-983096606251 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:59.909921 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-79f83df6-135a-498c-8586-983096606251 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:34:59.910374 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-79f83df6-135a-498c-8586-983096606251 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:34:59.910799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-79f83df6-135a-498c-8586-983096606251 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:34:59.945360 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-79f83df6-135a-498c-8586-983096606251 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050549 Oct 04 03:34:59.946059 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 354/701] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:34:59 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:35:00.093565 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-cbbb8481-37ed-4e60-827c-d70e0b02b93f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:00.094915 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-cbbb8481-37ed-4e60-827c-d70e0b02b93f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:00.101850 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cbbb8481-37ed-4e60-827c-d70e0b02b93f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:00.102531 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cbbb8481-37ed-4e60-827c-d70e0b02b93f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:00.102967 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cbbb8481-37ed-4e60-827c-d70e0b02b93f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:00.103729 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cbbb8481-37ed-4e60-827c-d70e0b02b93f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:00.104309 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cbbb8481-37ed-4e60-827c-d70e0b02b93f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:00.104880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cbbb8481-37ed-4e60-827c-d70e0b02b93f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:00.125100 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a256e4f0-af75-48ba-8e03-dc36520d9aef tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:00.127959 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a256e4f0-af75-48ba-8e03-dc36520d9aef tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:00.142255 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a256e4f0-af75-48ba-8e03-dc36520d9aef tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:00.143577 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-cbbb8481-37ed-4e60-827c-d70e0b02b93f tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments/71c202ea-1292-4a6a-bda5-1e2d4f157e43" status: 200 len: 194 microversion: 2.1 time: 0.054651 Oct 04 03:35:00.144287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a256e4f0-af75-48ba-8e03-dc36520d9aef tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:00.144772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 348/702] 10.222.0.25 () {58 vars in 1413 bytes} [Tue Oct 4 03:35:00 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments/71c202ea-1292-4a6a-bda5-1e2d4f157e43 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:35:00.151235 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a256e4f0-af75-48ba-8e03-dc36520d9aef tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:00.153972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a256e4f0-af75-48ba-8e03-dc36520d9aef tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:00.154453 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a256e4f0-af75-48ba-8e03-dc36520d9aef tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:00.155128 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a256e4f0-af75-48ba-8e03-dc36520d9aef tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:00.157302 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6f88fc7a-d598-44a5-8cf3-d3dd14a5a285 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:00.157901 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6f88fc7a-d598-44a5-8cf3-d3dd14a5a285 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:00.165145 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6f88fc7a-d598-44a5-8cf3-d3dd14a5a285 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:00.166585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6f88fc7a-d598-44a5-8cf3-d3dd14a5a285 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:00.167480 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6f88fc7a-d598-44a5-8cf3-d3dd14a5a285 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:00.168452 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6f88fc7a-d598-44a5-8cf3-d3dd14a5a285 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:00.169029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6f88fc7a-d598-44a5-8cf3-d3dd14a5a285 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:00.169621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6f88fc7a-d598-44a5-8cf3-d3dd14a5a285 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:00.280549 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-6f88fc7a-d598-44a5-8cf3-d3dd14a5a285 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lazy-loading 'services' on Instance uuid 88de3151-74fc-49a6-9577-148cf0835d88 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:35:00.341178 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a256e4f0-af75-48ba-8e03-dc36520d9aef tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:00.351699 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a256e4f0-af75-48ba-8e03-dc36520d9aef tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:00.353184 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a256e4f0-af75-48ba-8e03-dc36520d9aef tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:00.354417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a256e4f0-af75-48ba-8e03-dc36520d9aef tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1737 microversion: 2.20 time: 0.233840 Oct 04 03:35:00.354957 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 355/703] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:00 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:35:00.372823 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6f88fc7a-d598-44a5-8cf3-d3dd14a5a285 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments/71c202ea-1292-4a6a-bda5-1e2d4f157e43" status: 202 len: 0 microversion: 2.1 time: 0.220681 Oct 04 03:35:00.373476 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 349/704] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Oct 4 03:35:00 2022] DELETE /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments/71c202ea-1292-4a6a-bda5-1e2d4f157e43 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:35:01.382017 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1a45694e-aa54-4068-b62d-ddc5a737fe48 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:01.382623 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1a45694e-aa54-4068-b62d-ddc5a737fe48 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:01.389795 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a45694e-aa54-4068-b62d-ddc5a737fe48 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:01.390640 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a45694e-aa54-4068-b62d-ddc5a737fe48 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:01.391254 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a45694e-aa54-4068-b62d-ddc5a737fe48 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:01.392165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a45694e-aa54-4068-b62d-ddc5a737fe48 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:01.392768 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a45694e-aa54-4068-b62d-ddc5a737fe48 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:01.393373 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a45694e-aa54-4068-b62d-ddc5a737fe48 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:01.548861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-849f5431-6b51-44ed-bdf7-b53d6f591682 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:01.549655 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-849f5431-6b51-44ed-bdf7-b53d6f591682 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:01.556220 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-849f5431-6b51-44ed-bdf7-b53d6f591682 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:01.557543 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-849f5431-6b51-44ed-bdf7-b53d6f591682 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:01.558217 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-849f5431-6b51-44ed-bdf7-b53d6f591682 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:01.558929 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-849f5431-6b51-44ed-bdf7-b53d6f591682 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:01.559382 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-849f5431-6b51-44ed-bdf7-b53d6f591682 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:01.559871 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-849f5431-6b51-44ed-bdf7-b53d6f591682 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:01.593342 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-849f5431-6b51-44ed-bdf7-b53d6f591682 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments/a6ddf36d-5ad9-406e-88fc-770a8a550d1e" status: 200 len: 194 microversion: 2.1 time: 0.049360 Oct 04 03:35:01.600167 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 350/705] 10.222.0.25 () {58 vars in 1413 bytes} [Tue Oct 4 03:35:01 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments/a6ddf36d-5ad9-406e-88fc-770a8a550d1e => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:35:01.605701 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d31d1035-ba7f-4ff6-a296-1cd8706c3d4e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:01.606397 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d31d1035-ba7f-4ff6-a296-1cd8706c3d4e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:01.612919 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d31d1035-ba7f-4ff6-a296-1cd8706c3d4e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:01.613652 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d31d1035-ba7f-4ff6-a296-1cd8706c3d4e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:01.614258 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d31d1035-ba7f-4ff6-a296-1cd8706c3d4e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:01.615174 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d31d1035-ba7f-4ff6-a296-1cd8706c3d4e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:01.615836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d31d1035-ba7f-4ff6-a296-1cd8706c3d4e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:01.616524 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d31d1035-ba7f-4ff6-a296-1cd8706c3d4e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:01.642779 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1a45694e-aa54-4068-b62d-ddc5a737fe48 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:01.653040 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1a45694e-aa54-4068-b62d-ddc5a737fe48 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:01.654886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-1a45694e-aa54-4068-b62d-ddc5a737fe48 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:01.656312 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1a45694e-aa54-4068-b62d-ddc5a737fe48 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1737 microversion: 2.20 time: 0.278976 Oct 04 03:35:01.656944 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 356/706] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:01 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1737 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:35:01.731643 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-d31d1035-ba7f-4ff6-a296-1cd8706c3d4e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lazy-loading 'services' on Instance uuid 88de3151-74fc-49a6-9577-148cf0835d88 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:35:01.848766 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d31d1035-ba7f-4ff6-a296-1cd8706c3d4e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments/a6ddf36d-5ad9-406e-88fc-770a8a550d1e" status: 202 len: 0 microversion: 2.1 time: 0.246814 Oct 04 03:35:01.849766 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 351/707] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Oct 4 03:35:01 2022] DELETE /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments/a6ddf36d-5ad9-406e-88fc-770a8a550d1e => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:35:02.686569 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5bd2f1bf-d6eb-41c0-ac60-b6be7262d46f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:02.687471 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5bd2f1bf-d6eb-41c0-ac60-b6be7262d46f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:02.713741 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bd2f1bf-d6eb-41c0-ac60-b6be7262d46f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:02.714645 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bd2f1bf-d6eb-41c0-ac60-b6be7262d46f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:02.716329 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bd2f1bf-d6eb-41c0-ac60-b6be7262d46f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:02.718334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bd2f1bf-d6eb-41c0-ac60-b6be7262d46f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:02.720447 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bd2f1bf-d6eb-41c0-ac60-b6be7262d46f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:02.721027 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bd2f1bf-d6eb-41c0-ac60-b6be7262d46f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:02.747460 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-f4d99cf3-73a7-4999-8c2f-71826b0b5451 req-510f93a9-3ae1-48b4-977d-c94e8da36244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528cda6-7d7e-4973-b37c-bcfccbd9351d", "name": "network-vif-plugged", "status": "completed", "tag": "f9bf7419-15c5-4815-98c4-9e6466299270"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:35:02.772288 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-f4d99cf3-73a7-4999-8c2f-71826b0b5451 req-510f93a9-3ae1-48b4-977d-c94e8da36244 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:02.773077 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-f4d99cf3-73a7-4999-8c2f-71826b0b5451 req-510f93a9-3ae1-48b4-977d-c94e8da36244 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:02.775651 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-f4d99cf3-73a7-4999-8c2f-71826b0b5451 req-510f93a9-3ae1-48b4-977d-c94e8da36244 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:02.798211 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-f4d99cf3-73a7-4999-8c2f-71826b0b5451 req-510f93a9-3ae1-48b4-977d-c94e8da36244 service nova] Creating event network-vif-plugged:f9bf7419-15c5-4815-98c4-9e6466299270 for instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d on hv-cinder-84914 Oct 04 03:35:02.813809 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-f4d99cf3-73a7-4999-8c2f-71826b0b5451 req-510f93a9-3ae1-48b4-977d-c94e8da36244 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073704 Oct 04 03:35:02.815284 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 352/708] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:35:02.921120 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5bd2f1bf-d6eb-41c0-ac60-b6be7262d46f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:02.935274 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5bd2f1bf-d6eb-41c0-ac60-b6be7262d46f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:02.936967 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5bd2f1bf-d6eb-41c0-ac60-b6be7262d46f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:02.938207 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5bd2f1bf-d6eb-41c0-ac60-b6be7262d46f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1737 microversion: 2.20 time: 0.260174 Oct 04 03:35:02.938836 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 357/709] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:02 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1737 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:03.082240 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-dd72ec50-d2f8-44b3-8a02-fa3144107c12 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:03.084512 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-dd72ec50-d2f8-44b3-8a02-fa3144107c12 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:03.094205 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dd72ec50-d2f8-44b3-8a02-fa3144107c12 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:03.095308 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dd72ec50-d2f8-44b3-8a02-fa3144107c12 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:03.095941 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dd72ec50-d2f8-44b3-8a02-fa3144107c12 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:03.096822 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dd72ec50-d2f8-44b3-8a02-fa3144107c12 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:03.097466 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dd72ec50-d2f8-44b3-8a02-fa3144107c12 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:03.098041 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dd72ec50-d2f8-44b3-8a02-fa3144107c12 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:03.127586 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:03.133594 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-dd72ec50-d2f8-44b3-8a02-fa3144107c12 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055949 Oct 04 03:35:03.141558 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 353/710] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:35:03 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 03:35:03.300723 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-77869f92-5d2c-4bf6-8e36-bc7aeb185b1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:03.303784 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-77869f92-5d2c-4bf6-8e36-bc7aeb185b1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:03.310499 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-77869f92-5d2c-4bf6-8e36-bc7aeb185b1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:03.310987 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-77869f92-5d2c-4bf6-8e36-bc7aeb185b1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:03.311416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-77869f92-5d2c-4bf6-8e36-bc7aeb185b1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:03.312442 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-77869f92-5d2c-4bf6-8e36-bc7aeb185b1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:03.313270 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-77869f92-5d2c-4bf6-8e36-bc7aeb185b1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:03.313938 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-77869f92-5d2c-4bf6-8e36-bc7aeb185b1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:03.351083 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-77869f92-5d2c-4bf6-8e36-bc7aeb185b1d tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054106 Oct 04 03:35:03.351663 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 358/711] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:35:03 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 03:35:03.433773 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-1d1ffd4a-5653-43b0-8d2e-f7d6ba5f7f6a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:03.434277 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-1d1ffd4a-5653-43b0-8d2e-f7d6ba5f7f6a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:03.445292 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1d1ffd4a-5653-43b0-8d2e-f7d6ba5f7f6a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:03.446071 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1d1ffd4a-5653-43b0-8d2e-f7d6ba5f7f6a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:03.446879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1d1ffd4a-5653-43b0-8d2e-f7d6ba5f7f6a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:03.448555 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1d1ffd4a-5653-43b0-8d2e-f7d6ba5f7f6a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:03.449287 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1d1ffd4a-5653-43b0-8d2e-f7d6ba5f7f6a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:03.449914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1d1ffd4a-5653-43b0-8d2e-f7d6ba5f7f6a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:03.481267 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-1d1ffd4a-5653-43b0-8d2e-f7d6ba5f7f6a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Going to try to terminate instance {{(pid=120595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:35:03.608363 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-1d1ffd4a-5653-43b0-8d2e-f7d6ba5f7f6a tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 204 len: 0 microversion: 2.1 time: 0.178643 Oct 04 03:35:03.610118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 354/712] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:35:03 2022] DELETE /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:35:03.618211 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ccae3afb-9618-4f1e-8100-6b7b4b685b10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:03.618865 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ccae3afb-9618-4f1e-8100-6b7b4b685b10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:03.627957 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ccae3afb-9618-4f1e-8100-6b7b4b685b10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:03.628983 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ccae3afb-9618-4f1e-8100-6b7b4b685b10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:03.629792 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ccae3afb-9618-4f1e-8100-6b7b4b685b10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:03.632871 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ccae3afb-9618-4f1e-8100-6b7b4b685b10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:03.633694 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ccae3afb-9618-4f1e-8100-6b7b4b685b10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:03.634590 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ccae3afb-9618-4f1e-8100-6b7b4b685b10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:03.810601 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ccae3afb-9618-4f1e-8100-6b7b4b685b10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:03.818799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ccae3afb-9618-4f1e-8100-6b7b4b685b10 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1675 microversion: 2.1 time: 0.204324 Oct 04 03:35:03.820658 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 359/713] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:03 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1675 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:35:03.969323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-24c7db9f-a05e-4d5e-ad72-5d03f61be152 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:03.970055 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-24c7db9f-a05e-4d5e-ad72-5d03f61be152 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:03.977200 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-24c7db9f-a05e-4d5e-ad72-5d03f61be152 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:03.977724 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-24c7db9f-a05e-4d5e-ad72-5d03f61be152 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:03.978167 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-24c7db9f-a05e-4d5e-ad72-5d03f61be152 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:03.979229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-24c7db9f-a05e-4d5e-ad72-5d03f61be152 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:03.979730 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-24c7db9f-a05e-4d5e-ad72-5d03f61be152 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:03.980166 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-24c7db9f-a05e-4d5e-ad72-5d03f61be152 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:04.154737 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-24c7db9f-a05e-4d5e-ad72-5d03f61be152 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:04.164125 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-24c7db9f-a05e-4d5e-ad72-5d03f61be152 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:04.166496 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-24c7db9f-a05e-4d5e-ad72-5d03f61be152 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:04.168450 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-24c7db9f-a05e-4d5e-ad72-5d03f61be152 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1737 microversion: 2.20 time: 0.203753 Oct 04 03:35:04.186774 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 355/714] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:03 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:04.844617 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8a9d2e33-919a-4647-8db8-81143bb52bc4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:04.845312 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8a9d2e33-919a-4647-8db8-81143bb52bc4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:04.852717 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a9d2e33-919a-4647-8db8-81143bb52bc4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:04.853540 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a9d2e33-919a-4647-8db8-81143bb52bc4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:04.854715 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a9d2e33-919a-4647-8db8-81143bb52bc4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:04.855775 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a9d2e33-919a-4647-8db8-81143bb52bc4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:04.856608 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a9d2e33-919a-4647-8db8-81143bb52bc4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:04.857437 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a9d2e33-919a-4647-8db8-81143bb52bc4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:05.009382 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-8a9d2e33-919a-4647-8db8-81143bb52bc4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:05.020123 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8a9d2e33-919a-4647-8db8-81143bb52bc4 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1675 microversion: 2.1 time: 0.179343 Oct 04 03:35:05.020798 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 360/715] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:04 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:35:05.195221 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9fea4d8a-5867-4c47-a6b3-d8bb71e8f0ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:05.195779 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-9fea4d8a-5867-4c47-a6b3-d8bb71e8f0ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:05.202328 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9fea4d8a-5867-4c47-a6b3-d8bb71e8f0ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:05.202812 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9fea4d8a-5867-4c47-a6b3-d8bb71e8f0ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:05.203433 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9fea4d8a-5867-4c47-a6b3-d8bb71e8f0ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:05.204322 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9fea4d8a-5867-4c47-a6b3-d8bb71e8f0ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:05.205329 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9fea4d8a-5867-4c47-a6b3-d8bb71e8f0ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:05.205948 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9fea4d8a-5867-4c47-a6b3-d8bb71e8f0ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:05.361855 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-9fea4d8a-5867-4c47-a6b3-d8bb71e8f0ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:05.373025 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-9fea4d8a-5867-4c47-a6b3-d8bb71e8f0ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:05.375176 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-9fea4d8a-5867-4c47-a6b3-d8bb71e8f0ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:05.377271 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-9fea4d8a-5867-4c47-a6b3-d8bb71e8f0ec tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1737 microversion: 2.20 time: 0.186015 Oct 04 03:35:05.378089 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 356/716] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:05 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:06.046152 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0df835b2-951e-4f44-8793-a39bcbb83bc2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:06.046985 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0df835b2-951e-4f44-8793-a39bcbb83bc2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:06.058225 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0df835b2-951e-4f44-8793-a39bcbb83bc2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:06.059353 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0df835b2-951e-4f44-8793-a39bcbb83bc2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:06.060040 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0df835b2-951e-4f44-8793-a39bcbb83bc2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:06.061069 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0df835b2-951e-4f44-8793-a39bcbb83bc2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:06.061739 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0df835b2-951e-4f44-8793-a39bcbb83bc2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:06.062379 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0df835b2-951e-4f44-8793-a39bcbb83bc2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:06.407077 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6d34124f-f021-427b-a566-764df4be5d9f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:06.407627 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6d34124f-f021-427b-a566-764df4be5d9f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:06.414477 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d34124f-f021-427b-a566-764df4be5d9f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:06.415348 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d34124f-f021-427b-a566-764df4be5d9f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:06.419638 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d34124f-f021-427b-a566-764df4be5d9f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:06.419638 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d34124f-f021-427b-a566-764df4be5d9f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:06.419638 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d34124f-f021-427b-a566-764df4be5d9f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:06.419638 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6d34124f-f021-427b-a566-764df4be5d9f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:06.658153 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-0df835b2-951e-4f44-8793-a39bcbb83bc2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:06.666711 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0df835b2-951e-4f44-8793-a39bcbb83bc2 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1675 microversion: 2.1 time: 0.624789 Oct 04 03:35:06.667947 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 361/717] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:06 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1675 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:35:06.688694 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6d34124f-f021-427b-a566-764df4be5d9f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:06.698772 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6d34124f-f021-427b-a566-764df4be5d9f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:06.700361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6d34124f-f021-427b-a566-764df4be5d9f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:06.701632 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6d34124f-f021-427b-a566-764df4be5d9f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1737 microversion: 2.20 time: 0.298508 Oct 04 03:35:06.702252 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 357/718] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:06 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1737 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:35:07.140627 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-ddba8d54-c4cf-40b7-ab31-7b8b66a705d4 req-450c174e-dd9e-49cd-89e0-d36a8160fe0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88de3151-74fc-49a6-9577-148cf0835d88", "name": "network-vif-deleted", "tag": "a993f04e-64f4-4fca-8b84-86ea7fef05bc"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:35:07.171043 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ddba8d54-c4cf-40b7-ab31-7b8b66a705d4 req-450c174e-dd9e-49cd-89e0-d36a8160fe0e service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:07.171864 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ddba8d54-c4cf-40b7-ab31-7b8b66a705d4 req-450c174e-dd9e-49cd-89e0-d36a8160fe0e service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:07.173815 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ddba8d54-c4cf-40b7-ab31-7b8b66a705d4 req-450c174e-dd9e-49cd-89e0-d36a8160fe0e service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:07.215220 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-ddba8d54-c4cf-40b7-ab31-7b8b66a705d4 req-450c174e-dd9e-49cd-89e0-d36a8160fe0e service nova] Creating event network-vif-deleted:a993f04e-64f4-4fca-8b84-86ea7fef05bc for instance 88de3151-74fc-49a6-9577-148cf0835d88 on hv-cinder-84914 Oct 04 03:35:07.221975 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-ddba8d54-c4cf-40b7-ab31-7b8b66a705d4 req-450c174e-dd9e-49cd-89e0-d36a8160fe0e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087020 Oct 04 03:35:07.226501 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 362/719] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:35:07.692103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-89cef2c9-d877-4bbf-a7b5-e8137414b8c9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:07.692897 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-89cef2c9-d877-4bbf-a7b5-e8137414b8c9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:07.703306 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89cef2c9-d877-4bbf-a7b5-e8137414b8c9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:07.705634 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89cef2c9-d877-4bbf-a7b5-e8137414b8c9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:07.706191 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89cef2c9-d877-4bbf-a7b5-e8137414b8c9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:07.707016 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89cef2c9-d877-4bbf-a7b5-e8137414b8c9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:07.707912 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89cef2c9-d877-4bbf-a7b5-e8137414b8c9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:07.708900 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89cef2c9-d877-4bbf-a7b5-e8137414b8c9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:07.731370 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-76db1597-98c0-40d7-aad3-f1d851c1d914 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:07.732245 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-76db1597-98c0-40d7-aad3-f1d851c1d914 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:07.745653 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-76db1597-98c0-40d7-aad3-f1d851c1d914 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:07.749280 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-76db1597-98c0-40d7-aad3-f1d851c1d914 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:07.750019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-76db1597-98c0-40d7-aad3-f1d851c1d914 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:07.753452 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-76db1597-98c0-40d7-aad3-f1d851c1d914 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:07.754166 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-76db1597-98c0-40d7-aad3-f1d851c1d914 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:07.754826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-76db1597-98c0-40d7-aad3-f1d851c1d914 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:07.784586 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89cef2c9-d877-4bbf-a7b5-e8137414b8c9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:07.786756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89cef2c9-d877-4bbf-a7b5-e8137414b8c9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:07.787475 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-89cef2c9-d877-4bbf-a7b5-e8137414b8c9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:07.792191 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-89cef2c9-d877-4bbf-a7b5-e8137414b8c9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lazy-loading 'fault' on Instance uuid 88de3151-74fc-49a6-9577-148cf0835d88 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:35:07.797284 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:07.870924 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-89cef2c9-d877-4bbf-a7b5-e8137414b8c9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f76bc3ab354c4a8e9941e1403274ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2011dec80f764558a3a0fe210cdd0755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:07.885798 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-89cef2c9-d877-4bbf-a7b5-e8137414b8c9 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 200 len: 1327 microversion: 2.1 time: 0.197370 Oct 04 03:35:07.886997 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 358/720] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:07 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 1327 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:35:08.001297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-76db1597-98c0-40d7-aad3-f1d851c1d914 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:08.012122 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-76db1597-98c0-40d7-aad3-f1d851c1d914 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:08.014057 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-76db1597-98c0-40d7-aad3-f1d851c1d914 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:08.015556 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-76db1597-98c0-40d7-aad3-f1d851c1d914 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1737 microversion: 2.20 time: 0.289229 Oct 04 03:35:08.031532 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 363/721] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:07 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1737 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:35:08.910332 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-03e47337-f513-43e9-b660-18292b964fe3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:08.911856 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-03e47337-f513-43e9-b660-18292b964fe3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:08.920069 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-03e47337-f513-43e9-b660-18292b964fe3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:08.920816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-03e47337-f513-43e9-b660-18292b964fe3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:08.921659 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-03e47337-f513-43e9-b660-18292b964fe3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:08.922544 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-03e47337-f513-43e9-b660-18292b964fe3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:08.923167 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-03e47337-f513-43e9-b660-18292b964fe3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:08.923630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-03e47337-f513-43e9-b660-18292b964fe3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:08.942029 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-03e47337-f513-43e9-b660-18292b964fe3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] HTTP exception thrown: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-03e47337-f513-43e9-b660-18292b964fe3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Request method failure captured: Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 HTTP/1.1 Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6imTXpCFrfUtRr6Xl2jNi1ZkpVTc3kROqki-pexiEhBj3pdcindQ8ak2ZcMuhhp30dP0KcmE79kyPP3QLyOem4LF07BrLklMBMjd3Ugc13skmHkONTHdGbuQe-_v4MEDkV9mT6BGvnTI-oPibdTunwxfCPkGeEG3FdFlsinpbdzhpE Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 2011dec80f764558a3a0fe210cdd0755 Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:35:08.944209 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:35:08.946188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2011dec80f764558a3a0fe210cdd0755"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2011dec80f764558a3a0fe210cdd0755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2011dec80f764558a3a0fe210cdd0755", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2011dec80f764558a3a0fe210cdd0755"}]}] Oct 04 03:35:08.946188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:08.946188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 2011dec80f764558a3a0fe210cdd0755 Oct 04 03:35:08.946188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:08.946188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-AttachVolumeTestJSON-2041044916-project Oct 04 03:35:08.946188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:35:08.946188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:35:08.946188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 02f76bc3ab354c4a8e9941e1403274ae Oct 04 03:35:08.946188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-AttachVolumeTestJSON-2041044916-project Oct 04 03:35:08.946188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:35:08.946188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:08.946188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '88de3151-74fc-49a6-9577-148cf0835d88'} Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:35:08.947204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:08.948892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:08.951123 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-03e47337-f513-43e9-b660-18292b964fe3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Returning 404 to user: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:35:08.951745 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-03e47337-f513-43e9-b660-18292b964fe3 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 404 len: 111 microversion: 2.1 time: 0.045336 Oct 04 03:35:08.956483 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 359/722] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:08 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:35:08.963627 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0edce707-f06e-49ba-a672-a1f4d5f23e5e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '.version_select at 0x7f165b3d9e50>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:08.984746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0edce707-f06e-49ba-a672-a1f4d5f23e5e tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517059178" status: 202 len: 0 microversion: 2.1 time: 0.026907 Oct 04 03:35:08.985927 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 364/723] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Oct 4 03:35:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517059178 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:35:09.042573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-4f1c6ab6-a05a-456e-a21c-6591f8450a2a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:09.044579 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-4f1c6ab6-a05a-456e-a21c-6591f8450a2a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:09.058507 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f1c6ab6-a05a-456e-a21c-6591f8450a2a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:09.059377 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f1c6ab6-a05a-456e-a21c-6591f8450a2a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:09.060039 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f1c6ab6-a05a-456e-a21c-6591f8450a2a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:09.061109 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f1c6ab6-a05a-456e-a21c-6591f8450a2a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:09.062022 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f1c6ab6-a05a-456e-a21c-6591f8450a2a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:09.062700 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f1c6ab6-a05a-456e-a21c-6591f8450a2a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:09.293559 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4f1c6ab6-a05a-456e-a21c-6591f8450a2a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:09.303305 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4f1c6ab6-a05a-456e-a21c-6591f8450a2a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:09.304793 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4f1c6ab6-a05a-456e-a21c-6591f8450a2a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:09.306034 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-4f1c6ab6-a05a-456e-a21c-6591f8450a2a tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1737 microversion: 2.20 time: 0.267730 Oct 04 03:35:09.307137 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 360/724] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:09 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1737 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:10.335834 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9a7afc94-e6fe-452a-9b3a-15d669a9b9cd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:10.337155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9a7afc94-e6fe-452a-9b3a-15d669a9b9cd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:10.352428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9a7afc94-e6fe-452a-9b3a-15d669a9b9cd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:10.353048 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9a7afc94-e6fe-452a-9b3a-15d669a9b9cd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:10.353814 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9a7afc94-e6fe-452a-9b3a-15d669a9b9cd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:10.354791 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9a7afc94-e6fe-452a-9b3a-15d669a9b9cd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:10.355419 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9a7afc94-e6fe-452a-9b3a-15d669a9b9cd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:10.356030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9a7afc94-e6fe-452a-9b3a-15d669a9b9cd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:10.520222 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9a7afc94-e6fe-452a-9b3a-15d669a9b9cd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:10.533434 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9a7afc94-e6fe-452a-9b3a-15d669a9b9cd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:10.535315 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9a7afc94-e6fe-452a-9b3a-15d669a9b9cd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:10.536861 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9a7afc94-e6fe-452a-9b3a-15d669a9b9cd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1737 microversion: 2.20 time: 0.205175 Oct 04 03:35:10.551944 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 365/725] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:10 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:11.564124 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d613b9cd-0a68-4f40-ad18-d43043eff40f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:11.564727 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d613b9cd-0a68-4f40-ad18-d43043eff40f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:11.567192 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:11.574105 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d613b9cd-0a68-4f40-ad18-d43043eff40f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:11.574833 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d613b9cd-0a68-4f40-ad18-d43043eff40f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:11.575338 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d613b9cd-0a68-4f40-ad18-d43043eff40f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:11.577792 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d613b9cd-0a68-4f40-ad18-d43043eff40f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:11.578386 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d613b9cd-0a68-4f40-ad18-d43043eff40f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:11.578895 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d613b9cd-0a68-4f40-ad18-d43043eff40f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:11.757598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d613b9cd-0a68-4f40-ad18-d43043eff40f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:11.767153 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d613b9cd-0a68-4f40-ad18-d43043eff40f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:11.768641 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d613b9cd-0a68-4f40-ad18-d43043eff40f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:11.769790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d613b9cd-0a68-4f40-ad18-d43043eff40f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1719 microversion: 2.20 time: 0.209674 Oct 04 03:35:11.770530 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 361/726] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:11 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1719 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:12.191464 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c66fafd6-4fa1-4535-8748-902b766ff988 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:12.192134 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c66fafd6-4fa1-4535-8748-902b766ff988 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:12.200160 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c66fafd6-4fa1-4535-8748-902b766ff988 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:12.200848 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c66fafd6-4fa1-4535-8748-902b766ff988 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:12.201628 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c66fafd6-4fa1-4535-8748-902b766ff988 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:12.202393 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c66fafd6-4fa1-4535-8748-902b766ff988 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:12.203056 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c66fafd6-4fa1-4535-8748-902b766ff988 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:12.203788 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c66fafd6-4fa1-4535-8748-902b766ff988 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:12.218285 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-c66fafd6-4fa1-4535-8748-902b766ff988 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] HTTP exception thrown: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c66fafd6-4fa1-4535-8748-902b766ff988 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Request method failure captured: Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: DELETE /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 HTTP/1.1 Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6imTXpCFrfUtRr6Xl2jNi1ZkpVTc3kROqki-pexiEhBj3pdcindQ8ak2ZcMuhhp30dP0KcmE79kyPP3QLyOem4LF07BrLklMBMjd3Ugc13skmHkONTHdGbuQe-_v4MEDkV9mT6BGvnTI-oPibdTunwxfCPkGeEG3FdFlsinpbdzhpE Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: 2011dec80f764558a3a0fe210cdd0755 Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:35:12.219954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:35:12.221521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2011dec80f764558a3a0fe210cdd0755"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2011dec80f764558a3a0fe210cdd0755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2011dec80f764558a3a0fe210cdd0755", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2011dec80f764558a3a0fe210cdd0755"}]}] Oct 04 03:35:12.221521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:12.221521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: 2011dec80f764558a3a0fe210cdd0755 Oct 04 03:35:12.221521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:12.221521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-AttachVolumeTestJSON-2041044916-project Oct 04 03:35:12.221521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:35:12.221521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:35:12.221521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: 02f76bc3ab354c4a8e9941e1403274ae Oct 04 03:35:12.221521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeTestJSON-2041044916-project Oct 04 03:35:12.221521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:35:12.221521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:12.221521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '88de3151-74fc-49a6-9577-148cf0835d88'} Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:35:12.222404 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:12.223920 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:12.225351 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c66fafd6-4fa1-4535-8748-902b766ff988 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Returning 404 to user: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:35:12.225351 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c66fafd6-4fa1-4535-8748-902b766ff988 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 404 len: 111 microversion: 2.1 time: 0.033729 Oct 04 03:35:12.225351 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 366/727] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:35:12 2022] DELETE /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:35:12.229872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-559ee397-77b0-40de-88c9-65ec8070a424 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:12.230488 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-559ee397-77b0-40de-88c9-65ec8070a424 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 88de3151-74fc-49a6-9577-148cf0835d88] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:12.236608 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-559ee397-77b0-40de-88c9-65ec8070a424 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:12.237095 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-559ee397-77b0-40de-88c9-65ec8070a424 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:12.237533 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-559ee397-77b0-40de-88c9-65ec8070a424 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:12.238238 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-559ee397-77b0-40de-88c9-65ec8070a424 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:12.238695 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-559ee397-77b0-40de-88c9-65ec8070a424 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:12.239121 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-559ee397-77b0-40de-88c9-65ec8070a424 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:12.253408 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-559ee397-77b0-40de-88c9-65ec8070a424 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] HTTP exception thrown: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-559ee397-77b0-40de-88c9-65ec8070a424 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Request method failure captured: Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 HTTP/1.1 Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6imTXpCFrfUtRr6Xl2jNi1ZkpVTc3kROqki-pexiEhBj3pdcindQ8ak2ZcMuhhp30dP0KcmE79kyPP3QLyOem4LF07BrLklMBMjd3Ugc13skmHkONTHdGbuQe-_v4MEDkV9mT6BGvnTI-oPibdTunwxfCPkGeEG3FdFlsinpbdzhpE Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 2011dec80f764558a3a0fe210cdd0755 Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:35:12.254930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:35:12.256493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2011dec80f764558a3a0fe210cdd0755"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2011dec80f764558a3a0fe210cdd0755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2011dec80f764558a3a0fe210cdd0755", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2011dec80f764558a3a0fe210cdd0755"}]}] Oct 04 03:35:12.256493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:12.256493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 2011dec80f764558a3a0fe210cdd0755 Oct 04 03:35:12.256493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:12.256493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-AttachVolumeTestJSON-2041044916-project Oct 04 03:35:12.256493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:35:12.256493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:35:12.256493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 02f76bc3ab354c4a8e9941e1403274ae Oct 04 03:35:12.256493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-AttachVolumeTestJSON-2041044916-project Oct 04 03:35:12.256493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:35:12.256493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:12.256493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '88de3151-74fc-49a6-9577-148cf0835d88'} Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:35:12.257398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. Oct 04 03:35:12.258802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:12.260306 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-559ee397-77b0-40de-88c9-65ec8070a424 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Returning 404 to user: Instance 88de3151-74fc-49a6-9577-148cf0835d88 could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:35:12.260306 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-559ee397-77b0-40de-88c9-65ec8070a424 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88" status: 404 len: 111 microversion: 2.1 time: 0.030334 Oct 04 03:35:12.260306 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 362/728] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:12 2022] GET /compute/v2.1/servers/88de3151-74fc-49a6-9577-148cf0835d88 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:35:12.797326 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-550ccd79-c0ee-4e76-9ac6-e62ce153abbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:12.797896 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-550ccd79-c0ee-4e76-9ac6-e62ce153abbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:12.805707 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-550ccd79-c0ee-4e76-9ac6-e62ce153abbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:12.806193 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-550ccd79-c0ee-4e76-9ac6-e62ce153abbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:12.806665 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-550ccd79-c0ee-4e76-9ac6-e62ce153abbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:12.807895 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-550ccd79-c0ee-4e76-9ac6-e62ce153abbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:12.808721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-550ccd79-c0ee-4e76-9ac6-e62ce153abbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:12.809232 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-550ccd79-c0ee-4e76-9ac6-e62ce153abbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:12.941472 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-550ccd79-c0ee-4e76-9ac6-e62ce153abbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:12.951115 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-550ccd79-c0ee-4e76-9ac6-e62ce153abbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:12.952654 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-550ccd79-c0ee-4e76-9ac6-e62ce153abbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:12.953861 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-550ccd79-c0ee-4e76-9ac6-e62ce153abbf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1719 microversion: 2.20 time: 0.160730 Oct 04 03:35:12.954409 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 367/729] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:12 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:13.398486 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f2d68c50-10f6-437e-a869-5cc47ceea115 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:13.399123 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f2d68c50-10f6-437e-a869-5cc47ceea115 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:13.406279 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f2d68c50-10f6-437e-a869-5cc47ceea115 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:13.406780 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f2d68c50-10f6-437e-a869-5cc47ceea115 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:13.407217 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f2d68c50-10f6-437e-a869-5cc47ceea115 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:13.407944 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f2d68c50-10f6-437e-a869-5cc47ceea115 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:13.408398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f2d68c50-10f6-437e-a869-5cc47ceea115 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:13.408820 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f2d68c50-10f6-437e-a869-5cc47ceea115 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:13.423177 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-f2d68c50-10f6-437e-a869-5cc47ceea115 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] HTTP exception thrown: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f2d68c50-10f6-437e-a869-5cc47ceea115 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Request method failure captured: Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: DELETE /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 HTTP/1.1 Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6imTXpCFrfUtRr6Xl2jNi1ZkpVTc3kROqki-pexiEhBj3pdcindQ8ak2ZcMuhhp30dP0KcmE79kyPP3QLyOem4LF07BrLklMBMjd3Ugc13skmHkONTHdGbuQe-_v4MEDkV9mT6BGvnTI-oPibdTunwxfCPkGeEG3FdFlsinpbdzhpE Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 2011dec80f764558a3a0fe210cdd0755 Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:35:13.424748 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:35:13.426297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2011dec80f764558a3a0fe210cdd0755"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2011dec80f764558a3a0fe210cdd0755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2011dec80f764558a3a0fe210cdd0755", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2011dec80f764558a3a0fe210cdd0755"}]}] Oct 04 03:35:13.426297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:13.426297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 2011dec80f764558a3a0fe210cdd0755 Oct 04 03:35:13.426297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:13.426297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-AttachVolumeTestJSON-2041044916-project Oct 04 03:35:13.426297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:35:13.426297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:35:13.426297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 02f76bc3ab354c4a8e9941e1403274ae Oct 04 03:35:13.426297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-AttachVolumeTestJSON-2041044916-project Oct 04 03:35:13.426297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:35:13.426297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:35:13.426297 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '6d49bbae-bf97-4c67-a54a-3625acee0ba0'} Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:35:13.427164 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:35:13.428621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:13.430343 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f2d68c50-10f6-437e-a869-5cc47ceea115 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Returning 404 to user: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:35:13.430343 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f2d68c50-10f6-437e-a869-5cc47ceea115 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 404 len: 111 microversion: 2.1 time: 0.031557 Oct 04 03:35:13.430343 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 363/730] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:35:13 2022] DELETE /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:35:13.435997 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c6482fa8-0a55-4dde-b476-b6dd0d4eb264 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:13.436603 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c6482fa8-0a55-4dde-b476-b6dd0d4eb264 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] [instance: 6d49bbae-bf97-4c67-a54a-3625acee0ba0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:13.443282 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6482fa8-0a55-4dde-b476-b6dd0d4eb264 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:13.444042 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6482fa8-0a55-4dde-b476-b6dd0d4eb264 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:13.444467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6482fa8-0a55-4dde-b476-b6dd0d4eb264 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:13.445168 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6482fa8-0a55-4dde-b476-b6dd0d4eb264 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:13.445616 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6482fa8-0a55-4dde-b476-b6dd0d4eb264 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:13.446057 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6482fa8-0a55-4dde-b476-b6dd0d4eb264 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:13.459982 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-c6482fa8-0a55-4dde-b476-b6dd0d4eb264 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] HTTP exception thrown: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c6482fa8-0a55-4dde-b476-b6dd0d4eb264 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Request method failure captured: Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 HTTP/1.1 Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6imTXpCFrfUtRr6Xl2jNi1ZkpVTc3kROqki-pexiEhBj3pdcindQ8ak2ZcMuhhp30dP0KcmE79kyPP3QLyOem4LF07BrLklMBMjd3Ugc13skmHkONTHdGbuQe-_v4MEDkV9mT6BGvnTI-oPibdTunwxfCPkGeEG3FdFlsinpbdzhpE Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: 2011dec80f764558a3a0fe210cdd0755 Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:35:13.461561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:35:13.463104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2011dec80f764558a3a0fe210cdd0755"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2011dec80f764558a3a0fe210cdd0755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2011dec80f764558a3a0fe210cdd0755", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2011dec80f764558a3a0fe210cdd0755"}]}] Oct 04 03:35:13.463104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:13.463104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: 2011dec80f764558a3a0fe210cdd0755 Oct 04 03:35:13.463104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2041044916 Oct 04 03:35:13.463104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-AttachVolumeTestJSON-2041044916-project Oct 04 03:35:13.463104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:35:13.463104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:35:13.463104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: 02f76bc3ab354c4a8e9941e1403274ae Oct 04 03:35:13.463104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeTestJSON-2041044916-project Oct 04 03:35:13.463104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:35:13.463104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:35:13.463104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '6d49bbae-bf97-4c67-a54a-3625acee0ba0'} Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:35:13.464055 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. Oct 04 03:35:13.465462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:13.466741 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c6482fa8-0a55-4dde-b476-b6dd0d4eb264 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] Returning 404 to user: Instance 6d49bbae-bf97-4c67-a54a-3625acee0ba0 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:35:13.466741 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c6482fa8-0a55-4dde-b476-b6dd0d4eb264 tempest-AttachVolumeTestJSON-2041044916 tempest-AttachVolumeTestJSON-2041044916-project] 10.222.0.25 "GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0" status: 404 len: 111 microversion: 2.1 time: 0.032031 Oct 04 03:35:13.466741 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 368/731] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:13 2022] GET /compute/v2.1/servers/6d49bbae-bf97-4c67-a54a-3625acee0ba0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:35:13.981431 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f4a6f2a2-cdd1-48dd-ab2a-4a06adebe0dd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:13.982046 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f4a6f2a2-cdd1-48dd-ab2a-4a06adebe0dd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:13.989994 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4a6f2a2-cdd1-48dd-ab2a-4a06adebe0dd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:13.990483 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4a6f2a2-cdd1-48dd-ab2a-4a06adebe0dd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:13.990951 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4a6f2a2-cdd1-48dd-ab2a-4a06adebe0dd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:13.991717 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4a6f2a2-cdd1-48dd-ab2a-4a06adebe0dd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:13.992172 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4a6f2a2-cdd1-48dd-ab2a-4a06adebe0dd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:13.992626 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4a6f2a2-cdd1-48dd-ab2a-4a06adebe0dd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:14.212509 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f4a6f2a2-cdd1-48dd-ab2a-4a06adebe0dd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:14.220743 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f4a6f2a2-cdd1-48dd-ab2a-4a06adebe0dd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:14.222211 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f4a6f2a2-cdd1-48dd-ab2a-4a06adebe0dd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:14.223429 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f4a6f2a2-cdd1-48dd-ab2a-4a06adebe0dd tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1722 microversion: 2.20 time: 0.246792 Oct 04 03:35:14.224000 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 364/732] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:13 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:14.251113 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-518d380f-9d8a-4e45-8bde-047e805a21cf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34ee1b27-bfdb-4a0c-abca-93aaf6732dc9"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:35:14.253540 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-518d380f-9d8a-4e45-8bde-047e805a21cf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:14.259557 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-518d380f-9d8a-4e45-8bde-047e805a21cf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:14.260080 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-518d380f-9d8a-4e45-8bde-047e805a21cf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:14.260513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-518d380f-9d8a-4e45-8bde-047e805a21cf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:14.261446 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-518d380f-9d8a-4e45-8bde-047e805a21cf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:14.262012 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-518d380f-9d8a-4e45-8bde-047e805a21cf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:14.262503 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-518d380f-9d8a-4e45-8bde-047e805a21cf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:14.584297 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-518d380f-9d8a-4e45-8bde-047e805a21cf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "POST /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.337092 Oct 04 03:35:14.585022 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 369/733] 10.222.0.25 () {62 vars in 1364 bytes} [Tue Oct 4 03:35:14 2022] POST /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d/os-volume_attachments => generated 188 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 03:35:14.686903 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-366b4a99-12f2-4c36-abcc-e46018956c10 req-840f2c18-06d9-44bc-a59a-216507b900b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528cda6-7d7e-4973-b37c-bcfccbd9351d", "name": "network-vif-unplugged", "status": "completed", "tag": "f9bf7419-15c5-4815-98c4-9e6466299270"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:35:14.699177 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-366b4a99-12f2-4c36-abcc-e46018956c10 req-840f2c18-06d9-44bc-a59a-216507b900b8 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:14.707397 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-366b4a99-12f2-4c36-abcc-e46018956c10 req-840f2c18-06d9-44bc-a59a-216507b900b8 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:14.709182 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-366b4a99-12f2-4c36-abcc-e46018956c10 req-840f2c18-06d9-44bc-a59a-216507b900b8 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:14.721674 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.compute.server_external_events [req-366b4a99-12f2-4c36-abcc-e46018956c10 req-840f2c18-06d9-44bc-a59a-216507b900b8 service nova] Unable to find a host for instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d. Dropping event network-vif-unplugged {{(pid=120595) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 03:35:14.722765 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-366b4a99-12f2-4c36-abcc-e46018956c10 req-840f2c18-06d9-44bc-a59a-216507b900b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039595 Oct 04 03:35:14.723822 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 365/734] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 03:35:14.741340 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-465565bc-85f3-4ed8-ae6a-eafbbe885d84 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:14.742228 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-465565bc-85f3-4ed8-ae6a-eafbbe885d84 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:14.755440 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-465565bc-85f3-4ed8-ae6a-eafbbe885d84 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:14.756554 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-465565bc-85f3-4ed8-ae6a-eafbbe885d84 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:14.757418 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-465565bc-85f3-4ed8-ae6a-eafbbe885d84 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:14.758764 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-465565bc-85f3-4ed8-ae6a-eafbbe885d84 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:14.760901 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-465565bc-85f3-4ed8-ae6a-eafbbe885d84 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:14.761527 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-465565bc-85f3-4ed8-ae6a-eafbbe885d84 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:15.020060 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-465565bc-85f3-4ed8-ae6a-eafbbe885d84 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d/os-volume_attachments/34ee1b27-bfdb-4a0c-abca-93aaf6732dc9" status: 202 len: 0 microversion: 2.20 time: 0.283913 Oct 04 03:35:15.020778 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 370/735] 10.222.0.25 () {60 vars in 1457 bytes} [Tue Oct 4 03:35:14 2022] DELETE /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d/os-volume_attachments/34ee1b27-bfdb-4a0c-abca-93aaf6732dc9 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:35:15.087226 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-328863f6-48ea-41d3-bf07-8afca0197ba2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:35:15.087883 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-328863f6-48ea-41d3-bf07-8afca0197ba2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:15.094375 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-328863f6-48ea-41d3-bf07-8afca0197ba2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:15.094495 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-328863f6-48ea-41d3-bf07-8afca0197ba2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:15.095046 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-328863f6-48ea-41d3-bf07-8afca0197ba2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:15.095774 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-328863f6-48ea-41d3-bf07-8afca0197ba2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:15.096227 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-328863f6-48ea-41d3-bf07-8afca0197ba2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:15.096648 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-328863f6-48ea-41d3-bf07-8afca0197ba2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:15.128737 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-328863f6-48ea-41d3-bf07-8afca0197ba2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120595) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 03:35:15.206503 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-328863f6-48ea-41d3-bf07-8afca0197ba2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "POST /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d/action" status: 202 len: 0 microversion: 2.20 time: 0.123067 Oct 04 03:35:15.207094 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 366/736] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Oct 4 03:35:15 2022] POST /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 03:35:15.215830 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2ceff4d3-b5e6-48fd-a6f5-b54a4377b2f2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:15.216672 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2ceff4d3-b5e6-48fd-a6f5-b54a4377b2f2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:15.223332 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ceff4d3-b5e6-48fd-a6f5-b54a4377b2f2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:15.224728 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ceff4d3-b5e6-48fd-a6f5-b54a4377b2f2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:15.225700 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ceff4d3-b5e6-48fd-a6f5-b54a4377b2f2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:15.226426 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ceff4d3-b5e6-48fd-a6f5-b54a4377b2f2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:15.226885 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ceff4d3-b5e6-48fd-a6f5-b54a4377b2f2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:15.227360 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ceff4d3-b5e6-48fd-a6f5-b54a4377b2f2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:15.412887 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2ceff4d3-b5e6-48fd-a6f5-b54a4377b2f2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:15.422447 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2ceff4d3-b5e6-48fd-a6f5-b54a4377b2f2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:15.424212 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2ceff4d3-b5e6-48fd-a6f5-b54a4377b2f2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:15.425770 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2ceff4d3-b5e6-48fd-a6f5-b54a4377b2f2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1670 microversion: 2.20 time: 0.214442 Oct 04 03:35:15.445220 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 371/737] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:15 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1670 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:35:16.454554 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-3e10d8e7-0d21-4150-a730-d1d75993a18d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:16.455216 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-3e10d8e7-0d21-4150-a730-d1d75993a18d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:16.461112 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3e10d8e7-0d21-4150-a730-d1d75993a18d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:16.461565 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3e10d8e7-0d21-4150-a730-d1d75993a18d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:16.461995 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3e10d8e7-0d21-4150-a730-d1d75993a18d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:16.462686 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3e10d8e7-0d21-4150-a730-d1d75993a18d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:16.464432 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3e10d8e7-0d21-4150-a730-d1d75993a18d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:16.464862 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3e10d8e7-0d21-4150-a730-d1d75993a18d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:16.670039 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-3e10d8e7-0d21-4150-a730-d1d75993a18d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:16.682645 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-3e10d8e7-0d21-4150-a730-d1d75993a18d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:16.684383 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-3e10d8e7-0d21-4150-a730-d1d75993a18d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:16.685779 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-3e10d8e7-0d21-4150-a730-d1d75993a18d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.235702 Oct 04 03:35:16.692886 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 367/738] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:16 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:17.718500 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-713fb3f7-d558-4fec-8735-fbf6b9f3a30c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:17.719976 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-713fb3f7-d558-4fec-8735-fbf6b9f3a30c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:17.733530 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-713fb3f7-d558-4fec-8735-fbf6b9f3a30c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:17.734028 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-713fb3f7-d558-4fec-8735-fbf6b9f3a30c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:17.734665 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-713fb3f7-d558-4fec-8735-fbf6b9f3a30c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:17.735439 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-713fb3f7-d558-4fec-8735-fbf6b9f3a30c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:17.735924 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-713fb3f7-d558-4fec-8735-fbf6b9f3a30c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:17.736550 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-713fb3f7-d558-4fec-8735-fbf6b9f3a30c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:17.935232 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-713fb3f7-d558-4fec-8735-fbf6b9f3a30c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:17.944574 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-713fb3f7-d558-4fec-8735-fbf6b9f3a30c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:17.946014 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-713fb3f7-d558-4fec-8735-fbf6b9f3a30c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:17.948308 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-713fb3f7-d558-4fec-8735-fbf6b9f3a30c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.238158 Oct 04 03:35:17.948685 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 372/739] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:17 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:18.975253 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6c2a2c2d-d004-44ca-b869-fc6426b7fd57 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:18.976028 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6c2a2c2d-d004-44ca-b869-fc6426b7fd57 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:18.988795 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6c2a2c2d-d004-44ca-b869-fc6426b7fd57 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:18.989352 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6c2a2c2d-d004-44ca-b869-fc6426b7fd57 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:18.990159 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6c2a2c2d-d004-44ca-b869-fc6426b7fd57 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:18.991474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6c2a2c2d-d004-44ca-b869-fc6426b7fd57 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:18.993296 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6c2a2c2d-d004-44ca-b869-fc6426b7fd57 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:18.993879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6c2a2c2d-d004-44ca-b869-fc6426b7fd57 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:19.241899 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6c2a2c2d-d004-44ca-b869-fc6426b7fd57 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:19.260938 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6c2a2c2d-d004-44ca-b869-fc6426b7fd57 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:19.265184 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6c2a2c2d-d004-44ca-b869-fc6426b7fd57 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:19.268188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6c2a2c2d-d004-44ca-b869-fc6426b7fd57 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.297643 Oct 04 03:35:19.273429 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 368/740] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:18 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:20.298535 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2adefccb-e1c8-4e4d-adaa-583a54b2cb88 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:20.299382 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2adefccb-e1c8-4e4d-adaa-583a54b2cb88 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:20.311741 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2adefccb-e1c8-4e4d-adaa-583a54b2cb88 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:20.312728 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2adefccb-e1c8-4e4d-adaa-583a54b2cb88 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:20.313349 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2adefccb-e1c8-4e4d-adaa-583a54b2cb88 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:20.314249 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2adefccb-e1c8-4e4d-adaa-583a54b2cb88 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:20.314762 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2adefccb-e1c8-4e4d-adaa-583a54b2cb88 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:20.315462 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2adefccb-e1c8-4e4d-adaa-583a54b2cb88 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:20.470446 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2adefccb-e1c8-4e4d-adaa-583a54b2cb88 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:20.485562 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2adefccb-e1c8-4e4d-adaa-583a54b2cb88 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:20.485562 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2adefccb-e1c8-4e4d-adaa-583a54b2cb88 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:20.487779 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2adefccb-e1c8-4e4d-adaa-583a54b2cb88 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.193882 Oct 04 03:35:20.488622 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 373/741] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:20 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:21.514491 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e45ea467-cbde-4a94-9654-b4600890c1f6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:21.515173 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e45ea467-cbde-4a94-9654-b4600890c1f6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:21.521980 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e45ea467-cbde-4a94-9654-b4600890c1f6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:21.522469 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e45ea467-cbde-4a94-9654-b4600890c1f6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:21.522909 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e45ea467-cbde-4a94-9654-b4600890c1f6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:21.523634 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e45ea467-cbde-4a94-9654-b4600890c1f6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:21.524090 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e45ea467-cbde-4a94-9654-b4600890c1f6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:21.524509 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e45ea467-cbde-4a94-9654-b4600890c1f6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:21.701923 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e45ea467-cbde-4a94-9654-b4600890c1f6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:21.713452 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e45ea467-cbde-4a94-9654-b4600890c1f6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:21.715108 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e45ea467-cbde-4a94-9654-b4600890c1f6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:21.716344 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e45ea467-cbde-4a94-9654-b4600890c1f6 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.205843 Oct 04 03:35:21.720722 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 369/742] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:21 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:22.746124 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-191fa54f-41ec-4eed-aaa2-29ff8c2c82b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:22.746737 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-191fa54f-41ec-4eed-aaa2-29ff8c2c82b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:22.753731 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-191fa54f-41ec-4eed-aaa2-29ff8c2c82b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:22.754446 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-191fa54f-41ec-4eed-aaa2-29ff8c2c82b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:22.754883 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-191fa54f-41ec-4eed-aaa2-29ff8c2c82b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:22.755607 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-191fa54f-41ec-4eed-aaa2-29ff8c2c82b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:22.756226 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-191fa54f-41ec-4eed-aaa2-29ff8c2c82b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:22.756757 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-191fa54f-41ec-4eed-aaa2-29ff8c2c82b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:22.923384 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-191fa54f-41ec-4eed-aaa2-29ff8c2c82b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:22.931997 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-191fa54f-41ec-4eed-aaa2-29ff8c2c82b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:22.933565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-191fa54f-41ec-4eed-aaa2-29ff8c2c82b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:22.935292 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-191fa54f-41ec-4eed-aaa2-29ff8c2c82b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.194705 Oct 04 03:35:22.937006 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 374/743] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:22 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:23.962473 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-bbb11ea3-3142-44ea-9610-7ef49f29218c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:23.964002 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-bbb11ea3-3142-44ea-9610-7ef49f29218c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:23.971240 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bbb11ea3-3142-44ea-9610-7ef49f29218c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:23.971993 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bbb11ea3-3142-44ea-9610-7ef49f29218c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:23.972435 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bbb11ea3-3142-44ea-9610-7ef49f29218c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:23.973316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bbb11ea3-3142-44ea-9610-7ef49f29218c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:23.973902 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bbb11ea3-3142-44ea-9610-7ef49f29218c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:23.974412 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bbb11ea3-3142-44ea-9610-7ef49f29218c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:23.979576 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:24.208823 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-bbb11ea3-3142-44ea-9610-7ef49f29218c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:24.236878 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-bbb11ea3-3142-44ea-9610-7ef49f29218c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:24.239799 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-bbb11ea3-3142-44ea-9610-7ef49f29218c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:24.241210 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-bbb11ea3-3142-44ea-9610-7ef49f29218c tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.282653 Oct 04 03:35:24.265038 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 370/744] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:23 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:35:25.279750 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f5436894-be36-4052-ad3e-027576c5fac0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:25.280390 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f5436894-be36-4052-ad3e-027576c5fac0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:25.284301 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:25.289792 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f5436894-be36-4052-ad3e-027576c5fac0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:25.290288 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f5436894-be36-4052-ad3e-027576c5fac0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:25.291467 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f5436894-be36-4052-ad3e-027576c5fac0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:25.293440 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f5436894-be36-4052-ad3e-027576c5fac0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:25.294079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f5436894-be36-4052-ad3e-027576c5fac0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:25.295301 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f5436894-be36-4052-ad3e-027576c5fac0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:25.498710 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f5436894-be36-4052-ad3e-027576c5fac0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:25.510339 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f5436894-be36-4052-ad3e-027576c5fac0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:25.518852 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f5436894-be36-4052-ad3e-027576c5fac0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:25.520473 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f5436894-be36-4052-ad3e-027576c5fac0 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.246288 Oct 04 03:35:25.521813 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 375/745] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:25 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:26.533325 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-48e25547-e8e0-4820-8f5c-2efe2fe52e10 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:26.534154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-48e25547-e8e0-4820-8f5c-2efe2fe52e10 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:26.540774 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48e25547-e8e0-4820-8f5c-2efe2fe52e10 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:26.541569 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48e25547-e8e0-4820-8f5c-2efe2fe52e10 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:26.542125 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48e25547-e8e0-4820-8f5c-2efe2fe52e10 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:26.542816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48e25547-e8e0-4820-8f5c-2efe2fe52e10 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:26.543432 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48e25547-e8e0-4820-8f5c-2efe2fe52e10 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:26.544031 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-48e25547-e8e0-4820-8f5c-2efe2fe52e10 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:26.549580 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b998250d-09bd-481d-ab91-35c05f2526f8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:26.550646 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b998250d-09bd-481d-ab91-35c05f2526f8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:26.559126 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b998250d-09bd-481d-ab91-35c05f2526f8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:26.559892 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b998250d-09bd-481d-ab91-35c05f2526f8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:26.560586 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b998250d-09bd-481d-ab91-35c05f2526f8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:26.562302 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b998250d-09bd-481d-ab91-35c05f2526f8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:26.563569 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b998250d-09bd-481d-ab91-35c05f2526f8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:26.564130 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b998250d-09bd-481d-ab91-35c05f2526f8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:26.575861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-48e25547-e8e0-4820-8f5c-2efe2fe52e10 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031/ips" status: 200 len: 150 microversion: 2.1 time: 0.361737 Oct 04 03:35:26.576500 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 371/746] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Oct 4 03:35:26 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031/ips => generated 150 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:35:27.070273 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b998250d-09bd-481d-ab91-35c05f2526f8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:27.080757 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b998250d-09bd-481d-ab91-35c05f2526f8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:27.082477 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b998250d-09bd-481d-ab91-35c05f2526f8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:27.083623 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b998250d-09bd-481d-ab91-35c05f2526f8 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.538862 Oct 04 03:35:27.084506 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 376/747] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:26 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:27.995131 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-848979ff-4081-4fa0-939c-958066d24665 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "551020fa-2556-4fff-a306-3b25f808e654"}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:35:27.997632 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-848979ff-4081-4fa0-939c-958066d24665 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:28.003935 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-848979ff-4081-4fa0-939c-958066d24665 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:28.004415 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-848979ff-4081-4fa0-939c-958066d24665 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:28.004850 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-848979ff-4081-4fa0-939c-958066d24665 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:28.005529 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-848979ff-4081-4fa0-939c-958066d24665 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:28.005978 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-848979ff-4081-4fa0-939c-958066d24665 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:28.006398 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-848979ff-4081-4fa0-939c-958066d24665 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:28.109277 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3125b4b3-2e71-4371-87ff-8326845a6d29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:28.109859 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3125b4b3-2e71-4371-87ff-8326845a6d29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:28.116680 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3125b4b3-2e71-4371-87ff-8326845a6d29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:28.117188 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3125b4b3-2e71-4371-87ff-8326845a6d29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:28.117618 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3125b4b3-2e71-4371-87ff-8326845a6d29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:28.118308 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3125b4b3-2e71-4371-87ff-8326845a6d29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:28.119272 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3125b4b3-2e71-4371-87ff-8326845a6d29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:28.119717 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3125b4b3-2e71-4371-87ff-8326845a6d29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:28.135698 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:28.255026 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-848979ff-4081-4fa0-939c-958066d24665 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "POST /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263936 Oct 04 03:35:28.255683 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 372/748] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Oct 4 03:35:27 2022] POST /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:35:28.257737 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-3125b4b3-2e71-4371-87ff-8326845a6d29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:28.278489 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-3125b4b3-2e71-4371-87ff-8326845a6d29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:28.279943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-3125b4b3-2e71-4371-87ff-8326845a6d29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:28.281093 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3125b4b3-2e71-4371-87ff-8326845a6d29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.175718 Oct 04 03:35:28.281640 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 377/749] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:28 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:35:29.309624 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-4d208882-1b7f-4093-b955-f95f7e19aa29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:29.310308 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-4d208882-1b7f-4093-b955-f95f7e19aa29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:29.316476 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4d208882-1b7f-4093-b955-f95f7e19aa29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:29.316956 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4d208882-1b7f-4093-b955-f95f7e19aa29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:29.317379 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4d208882-1b7f-4093-b955-f95f7e19aa29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:29.318061 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4d208882-1b7f-4093-b955-f95f7e19aa29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:29.318507 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4d208882-1b7f-4093-b955-f95f7e19aa29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:29.319185 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4d208882-1b7f-4093-b955-f95f7e19aa29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:29.450954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4d208882-1b7f-4093-b955-f95f7e19aa29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:29.459096 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4d208882-1b7f-4093-b955-f95f7e19aa29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:29.460615 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4d208882-1b7f-4093-b955-f95f7e19aa29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:29.461705 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-4d208882-1b7f-4093-b955-f95f7e19aa29 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.157548 Oct 04 03:35:29.462254 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 373/750] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:29 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:29.557571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ba573bcc-fc41-4c91-83a6-68e850719261 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:29.558091 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ba573bcc-fc41-4c91-83a6-68e850719261 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:29.564384 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ba573bcc-fc41-4c91-83a6-68e850719261 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:29.564856 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ba573bcc-fc41-4c91-83a6-68e850719261 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:29.565279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ba573bcc-fc41-4c91-83a6-68e850719261 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:29.565959 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ba573bcc-fc41-4c91-83a6-68e850719261 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:29.566400 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ba573bcc-fc41-4c91-83a6-68e850719261 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:29.566813 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ba573bcc-fc41-4c91-83a6-68e850719261 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:29.651014 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-ba573bcc-fc41-4c91-83a6-68e850719261 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lazy-loading 'services' on Instance uuid 4d704ae4-024f-4f05-8c08-2853b755b031 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:35:29.721779 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ba573bcc-fc41-4c91-83a6-68e850719261 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031/os-volume_attachments/551020fa-2556-4fff-a306-3b25f808e654" status: 202 len: 0 microversion: 2.1 time: 0.167963 Oct 04 03:35:29.722369 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 378/751] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Oct 4 03:35:29 2022] DELETE /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031/os-volume_attachments/551020fa-2556-4fff-a306-3b25f808e654 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:35:29.731344 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f0d2b8f4-aa5a-4e4a-82ae-50d35089854f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:29.733596 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f0d2b8f4-aa5a-4e4a-82ae-50d35089854f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:29.739963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f0d2b8f4-aa5a-4e4a-82ae-50d35089854f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:29.740446 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f0d2b8f4-aa5a-4e4a-82ae-50d35089854f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:29.740876 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f0d2b8f4-aa5a-4e4a-82ae-50d35089854f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:29.741563 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f0d2b8f4-aa5a-4e4a-82ae-50d35089854f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:29.742069 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f0d2b8f4-aa5a-4e4a-82ae-50d35089854f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:29.742427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f0d2b8f4-aa5a-4e4a-82ae-50d35089854f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:29.773122 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f0d2b8f4-aa5a-4e4a-82ae-50d35089854f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046339 Oct 04 03:35:29.773674 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 374/752] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:35:29 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:35:30.489135 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f7f30138-fc2c-423e-a290-9d5e24475bb5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:30.489738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f7f30138-fc2c-423e-a290-9d5e24475bb5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:30.497044 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7f30138-fc2c-423e-a290-9d5e24475bb5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:30.497519 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7f30138-fc2c-423e-a290-9d5e24475bb5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:30.497944 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7f30138-fc2c-423e-a290-9d5e24475bb5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:30.498627 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7f30138-fc2c-423e-a290-9d5e24475bb5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:30.499124 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7f30138-fc2c-423e-a290-9d5e24475bb5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:30.499562 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7f30138-fc2c-423e-a290-9d5e24475bb5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:30.632166 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f7f30138-fc2c-423e-a290-9d5e24475bb5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:30.640986 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f7f30138-fc2c-423e-a290-9d5e24475bb5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:30.642506 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f7f30138-fc2c-423e-a290-9d5e24475bb5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:30.643963 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f7f30138-fc2c-423e-a290-9d5e24475bb5 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.159174 Oct 04 03:35:30.644527 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 379/753] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:30 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:30.787276 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7d358b0d-63f9-4eed-89fc-971f815b4c65 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:30.789570 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7d358b0d-63f9-4eed-89fc-971f815b4c65 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:30.797799 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d358b0d-63f9-4eed-89fc-971f815b4c65 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:30.798360 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d358b0d-63f9-4eed-89fc-971f815b4c65 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:30.798827 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d358b0d-63f9-4eed-89fc-971f815b4c65 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:30.799552 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d358b0d-63f9-4eed-89fc-971f815b4c65 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:30.800009 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d358b0d-63f9-4eed-89fc-971f815b4c65 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:30.800434 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d358b0d-63f9-4eed-89fc-971f815b4c65 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:30.832222 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7d358b0d-63f9-4eed-89fc-971f815b4c65 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051453 Oct 04 03:35:30.832804 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 380/754] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:35:30 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 03:35:30.897653 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1bf0f35c-fbe2-4b34-9070-148977d82874 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:30.898231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1bf0f35c-fbe2-4b34-9070-148977d82874 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:30.905472 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bf0f35c-fbe2-4b34-9070-148977d82874 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:30.905964 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bf0f35c-fbe2-4b34-9070-148977d82874 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:30.906392 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bf0f35c-fbe2-4b34-9070-148977d82874 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:30.907288 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bf0f35c-fbe2-4b34-9070-148977d82874 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:30.907766 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bf0f35c-fbe2-4b34-9070-148977d82874 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:30.908374 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bf0f35c-fbe2-4b34-9070-148977d82874 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:30.934492 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1bf0f35c-fbe2-4b34-9070-148977d82874 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:35:30.962759 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-3f88a15f-c63b-465f-9d4f-d29ff7b44f99 req-69ac0ef9-8f04-4a73-b46f-16286e69984f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528cda6-7d7e-4973-b37c-bcfccbd9351d", "name": "network-vif-plugged", "status": "completed", "tag": "f9bf7419-15c5-4815-98c4-9e6466299270"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:35:30.972102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-3f88a15f-c63b-465f-9d4f-d29ff7b44f99 req-69ac0ef9-8f04-4a73-b46f-16286e69984f service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:30.972671 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-3f88a15f-c63b-465f-9d4f-d29ff7b44f99 req-69ac0ef9-8f04-4a73-b46f-16286e69984f service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:30.973190 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-3f88a15f-c63b-465f-9d4f-d29ff7b44f99 req-69ac0ef9-8f04-4a73-b46f-16286e69984f service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:30.985353 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-3f88a15f-c63b-465f-9d4f-d29ff7b44f99 req-69ac0ef9-8f04-4a73-b46f-16286e69984f service nova] Creating event network-vif-plugged:f9bf7419-15c5-4815-98c4-9e6466299270 for instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d on hv-cinder-84914 Oct 04 03:35:30.991321 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-3f88a15f-c63b-465f-9d4f-d29ff7b44f99 req-69ac0ef9-8f04-4a73-b46f-16286e69984f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225830 Oct 04 03:35:30.992454 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 375/755] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:35:31.016289 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1bf0f35c-fbe2-4b34-9070-148977d82874 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 204 len: 0 microversion: 2.1 time: 0.122203 Oct 04 03:35:31.016842 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 381/756] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:35:30 2022] DELETE /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 03:35:31.026299 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0e144223-6724-454d-a226-9d5e95daedf5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:31.026998 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-0e144223-6724-454d-a226-9d5e95daedf5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:31.033074 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e144223-6724-454d-a226-9d5e95daedf5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:31.033558 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e144223-6724-454d-a226-9d5e95daedf5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:31.033991 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e144223-6724-454d-a226-9d5e95daedf5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:31.034669 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e144223-6724-454d-a226-9d5e95daedf5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:31.035117 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e144223-6724-454d-a226-9d5e95daedf5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:31.035561 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0e144223-6724-454d-a226-9d5e95daedf5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:31.163410 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0e144223-6724-454d-a226-9d5e95daedf5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:31.171591 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0e144223-6724-454d-a226-9d5e95daedf5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1682 microversion: 2.1 time: 0.150227 Oct 04 03:35:31.172162 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 376/757] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:31 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:35:31.670684 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-70fa2eae-8647-436c-acd6-0ff4a179f03f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:31.671372 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-70fa2eae-8647-436c-acd6-0ff4a179f03f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:31.677712 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70fa2eae-8647-436c-acd6-0ff4a179f03f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:31.678314 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70fa2eae-8647-436c-acd6-0ff4a179f03f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:31.678810 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70fa2eae-8647-436c-acd6-0ff4a179f03f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:31.679498 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70fa2eae-8647-436c-acd6-0ff4a179f03f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:31.679949 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70fa2eae-8647-436c-acd6-0ff4a179f03f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:31.680359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70fa2eae-8647-436c-acd6-0ff4a179f03f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:31.806817 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-70fa2eae-8647-436c-acd6-0ff4a179f03f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:31.815568 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-70fa2eae-8647-436c-acd6-0ff4a179f03f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:31.817155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-70fa2eae-8647-436c-acd6-0ff4a179f03f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:31.818300 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-70fa2eae-8647-436c-acd6-0ff4a179f03f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.152524 Oct 04 03:35:31.819202 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 382/758] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:31 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:32.196207 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-1faaf0dc-ef56-4087-b565-01f9b4559408 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:32.196793 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-1faaf0dc-ef56-4087-b565-01f9b4559408 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:32.203514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1faaf0dc-ef56-4087-b565-01f9b4559408 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:32.203987 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1faaf0dc-ef56-4087-b565-01f9b4559408 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:32.204420 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1faaf0dc-ef56-4087-b565-01f9b4559408 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:32.205098 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1faaf0dc-ef56-4087-b565-01f9b4559408 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:32.205545 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1faaf0dc-ef56-4087-b565-01f9b4559408 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:32.205966 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1faaf0dc-ef56-4087-b565-01f9b4559408 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:32.342893 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-1faaf0dc-ef56-4087-b565-01f9b4559408 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:32.350672 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-1faaf0dc-ef56-4087-b565-01f9b4559408 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1682 microversion: 2.1 time: 0.158641 Oct 04 03:35:32.351249 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 377/759] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:32 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:35:32.846154 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7e59baec-6cba-49bd-842b-fc2d9f19cd06 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:32.846769 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7e59baec-6cba-49bd-842b-fc2d9f19cd06 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:32.853489 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e59baec-6cba-49bd-842b-fc2d9f19cd06 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:32.853968 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e59baec-6cba-49bd-842b-fc2d9f19cd06 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:32.854465 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e59baec-6cba-49bd-842b-fc2d9f19cd06 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:32.855076 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e59baec-6cba-49bd-842b-fc2d9f19cd06 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:32.855729 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e59baec-6cba-49bd-842b-fc2d9f19cd06 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:32.856154 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e59baec-6cba-49bd-842b-fc2d9f19cd06 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:33.075877 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-7e59baec-6cba-49bd-842b-fc2d9f19cd06 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:33.087691 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-7e59baec-6cba-49bd-842b-fc2d9f19cd06 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:33.089644 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-7e59baec-6cba-49bd-842b-fc2d9f19cd06 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:33.091724 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7e59baec-6cba-49bd-842b-fc2d9f19cd06 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.249371 Oct 04 03:35:33.092487 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 383/760] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:32 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:35:33.374256 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a70c1931-29fd-4ea7-aed4-30ea0bcc039a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:33.374882 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a70c1931-29fd-4ea7-aed4-30ea0bcc039a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:33.381888 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a70c1931-29fd-4ea7-aed4-30ea0bcc039a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:33.382364 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a70c1931-29fd-4ea7-aed4-30ea0bcc039a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:33.382954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a70c1931-29fd-4ea7-aed4-30ea0bcc039a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:33.383879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a70c1931-29fd-4ea7-aed4-30ea0bcc039a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:33.384360 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a70c1931-29fd-4ea7-aed4-30ea0bcc039a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:33.384778 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a70c1931-29fd-4ea7-aed4-30ea0bcc039a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:33.611928 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a70c1931-29fd-4ea7-aed4-30ea0bcc039a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8795829c34046628cae345dd4d45e75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d6ee89cb464afa95e222b2a1e7279b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:33.621361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a70c1931-29fd-4ea7-aed4-30ea0bcc039a tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 200 len: 1682 microversion: 2.1 time: 0.250880 Oct 04 03:35:33.621945 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 378/761] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:33 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 1682 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:35:34.118020 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-973a5b47-2c51-4a44-8123-d1d7f98770b2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:34.119147 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-973a5b47-2c51-4a44-8123-d1d7f98770b2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:34.127906 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-973a5b47-2c51-4a44-8123-d1d7f98770b2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:34.130033 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-973a5b47-2c51-4a44-8123-d1d7f98770b2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:34.130627 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-973a5b47-2c51-4a44-8123-d1d7f98770b2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:34.131165 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-973a5b47-2c51-4a44-8123-d1d7f98770b2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:34.131631 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-973a5b47-2c51-4a44-8123-d1d7f98770b2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:34.132053 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-973a5b47-2c51-4a44-8123-d1d7f98770b2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:34.266210 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-9b33a991-11ad-4aff-a2e5-74041f821329 req-77e86d00-9897-49f4-9522-ebdc2d224c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d704ae4-024f-4f05-8c08-2853b755b031", "name": "network-vif-deleted", "tag": "972122cd-e121-416b-a905-f6ab52c59458"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:35:34.285332 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9b33a991-11ad-4aff-a2e5-74041f821329 req-77e86d00-9897-49f4-9522-ebdc2d224c82 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:34.285817 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9b33a991-11ad-4aff-a2e5-74041f821329 req-77e86d00-9897-49f4-9522-ebdc2d224c82 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:34.286245 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9b33a991-11ad-4aff-a2e5-74041f821329 req-77e86d00-9897-49f4-9522-ebdc2d224c82 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:34.299665 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-9b33a991-11ad-4aff-a2e5-74041f821329 req-77e86d00-9897-49f4-9522-ebdc2d224c82 service nova] Creating event network-vif-deleted:972122cd-e121-416b-a905-f6ab52c59458 for instance 4d704ae4-024f-4f05-8c08-2853b755b031 on hv-cinder-84914 Oct 04 03:35:34.306286 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-9b33a991-11ad-4aff-a2e5-74041f821329 req-77e86d00-9897-49f4-9522-ebdc2d224c82 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.422786 Oct 04 03:35:34.307215 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 384/762] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:35:34.328505 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-973a5b47-2c51-4a44-8123-d1d7f98770b2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:34.338192 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-973a5b47-2c51-4a44-8123-d1d7f98770b2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:34.339866 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-973a5b47-2c51-4a44-8123-d1d7f98770b2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:34.341273 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-973a5b47-2c51-4a44-8123-d1d7f98770b2 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1728 microversion: 2.20 time: 0.227052 Oct 04 03:35:34.358953 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 379/763] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:34 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1728 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 03:35:34.651522 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-45cea526-d98c-447c-b5e7-ae9e1a00c6d5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:34.653904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-45cea526-d98c-447c-b5e7-ae9e1a00c6d5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:34.668483 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45cea526-d98c-447c-b5e7-ae9e1a00c6d5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:34.670089 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45cea526-d98c-447c-b5e7-ae9e1a00c6d5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:34.670597 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45cea526-d98c-447c-b5e7-ae9e1a00c6d5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:34.672016 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45cea526-d98c-447c-b5e7-ae9e1a00c6d5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:34.673425 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45cea526-d98c-447c-b5e7-ae9e1a00c6d5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:34.673982 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45cea526-d98c-447c-b5e7-ae9e1a00c6d5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:34.693546 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-45cea526-d98c-447c-b5e7-ae9e1a00c6d5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] HTTP exception thrown: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-45cea526-d98c-447c-b5e7-ae9e1a00c6d5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Request method failure captured: Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 HTTP/1.1 Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6isUYhgYsAb2pqxJ5i2_6gzGtKyJzLe2quMbLKiFrXtrxQIhaAv2XwsUqEAkN7Fh1WqlIXaqgH_JRfN3W7XWKG2TyqZRi_OBW_0jILA2kaoQ2SSAvWUeuuoQxbaW7Q90VlSmfhWYx2fgtTX4JS2Hb0X2tvDyvvlYbTndLm_mtGSa4s Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:35:34.695565 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:35:34.697542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d6ee89cb464afa95e222b2a1e7279b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d6ee89cb464afa95e222b2a1e7279b"}]}] Oct 04 03:35:34.697542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:34.697542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:34.697542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:34.697542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:34.697542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:35:34.697542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:35:34.697542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: b8795829c34046628cae345dd4d45e75 Oct 04 03:35:34.697542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:34.697542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:35:34.697542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:34.697542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '4d704ae4-024f-4f05-8c08-2853b755b031'} Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:35:34.698428 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:34.699721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:34.700863 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-45cea526-d98c-447c-b5e7-ae9e1a00c6d5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Returning 404 to user: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:35:34.700863 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-45cea526-d98c-447c-b5e7-ae9e1a00c6d5 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 404 len: 111 microversion: 2.1 time: 0.055516 Oct 04 03:35:34.700863 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 385/764] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:34 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:35:34.707594 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-edc0531e-de58-4b52-af3b-f59831b8c2a8 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '.version_select at 0x7f165b419940>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:34.742131 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-edc0531e-de58-4b52-af3b-f59831b8c2a8 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1223998132" status: 202 len: 0 microversion: 2.1 time: 0.037683 Oct 04 03:35:34.746800 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 380/765] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Oct 4 03:35:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1223998132 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:35:35.368017 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5dc8a362-551f-41c4-8656-7d87adecdd41 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:35.369729 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5dc8a362-551f-41c4-8656-7d87adecdd41 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:35.376683 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5dc8a362-551f-41c4-8656-7d87adecdd41 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:35.377352 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5dc8a362-551f-41c4-8656-7d87adecdd41 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:35.377851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5dc8a362-551f-41c4-8656-7d87adecdd41 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:35.378876 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5dc8a362-551f-41c4-8656-7d87adecdd41 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:35.379353 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5dc8a362-551f-41c4-8656-7d87adecdd41 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:35.380005 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5dc8a362-551f-41c4-8656-7d87adecdd41 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:35.566584 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5dc8a362-551f-41c4-8656-7d87adecdd41 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:35.576788 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5dc8a362-551f-41c4-8656-7d87adecdd41 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:35.578430 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-5dc8a362-551f-41c4-8656-7d87adecdd41 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:35:35.579763 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5dc8a362-551f-41c4-8656-7d87adecdd41 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1715 microversion: 2.20 time: 0.217230 Oct 04 03:35:35.580781 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 386/766] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:35:35 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1715 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:35:36.708792 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9f453635-567e-40b3-904a-e4361021fafe tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:36.709494 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-9f453635-567e-40b3-904a-e4361021fafe tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:36.717133 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9f453635-567e-40b3-904a-e4361021fafe tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:36.717620 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9f453635-567e-40b3-904a-e4361021fafe tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:36.718051 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9f453635-567e-40b3-904a-e4361021fafe tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:36.718741 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9f453635-567e-40b3-904a-e4361021fafe tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:36.719187 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9f453635-567e-40b3-904a-e4361021fafe tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:36.719640 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9f453635-567e-40b3-904a-e4361021fafe tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:36.733944 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-9f453635-567e-40b3-904a-e4361021fafe tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] HTTP exception thrown: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9f453635-567e-40b3-904a-e4361021fafe tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Request method failure captured: Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: DELETE /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 HTTP/1.1 Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6isUYhgYsAb2pqxJ5i2_6gzGtKyJzLe2quMbLKiFrXtrxQIhaAv2XwsUqEAkN7Fh1WqlIXaqgH_JRfN3W7XWKG2TyqZRi_OBW_0jILA2kaoQ2SSAvWUeuuoQxbaW7Q90VlSmfhWYx2fgtTX4JS2Hb0X2tvDyvvlYbTndLm_mtGSa4s Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:35:36.735514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:35:36.736853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d6ee89cb464afa95e222b2a1e7279b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d6ee89cb464afa95e222b2a1e7279b"}]}] Oct 04 03:35:36.736853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:36.736853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:36.736853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:36.736853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:36.736853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:35:36.736853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:35:36.736853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: b8795829c34046628cae345dd4d45e75 Oct 04 03:35:36.736853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:36.736853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:35:36.736853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:36.736853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '4d704ae4-024f-4f05-8c08-2853b755b031'} Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:35:36.737602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:36.738843 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:36.740109 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9f453635-567e-40b3-904a-e4361021fafe tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Returning 404 to user: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:35:36.740109 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-9f453635-567e-40b3-904a-e4361021fafe tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 404 len: 111 microversion: 2.1 time: 0.031978 Oct 04 03:35:36.740109 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 381/767] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:35:36 2022] DELETE /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:35:36.746629 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0bf11828-04f3-4fb9-a892-0b8b6574e2f8 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:36.747445 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0bf11828-04f3-4fb9-a892-0b8b6574e2f8 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 4d704ae4-024f-4f05-8c08-2853b755b031] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:36.754341 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf11828-04f3-4fb9-a892-0b8b6574e2f8 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:36.754897 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf11828-04f3-4fb9-a892-0b8b6574e2f8 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:36.755399 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf11828-04f3-4fb9-a892-0b8b6574e2f8 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:36.756257 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf11828-04f3-4fb9-a892-0b8b6574e2f8 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:36.756785 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf11828-04f3-4fb9-a892-0b8b6574e2f8 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:36.757397 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf11828-04f3-4fb9-a892-0b8b6574e2f8 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:36.771599 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-0bf11828-04f3-4fb9-a892-0b8b6574e2f8 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] HTTP exception thrown: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0bf11828-04f3-4fb9-a892-0b8b6574e2f8 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Request method failure captured: Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 HTTP/1.1 Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6isUYhgYsAb2pqxJ5i2_6gzGtKyJzLe2quMbLKiFrXtrxQIhaAv2XwsUqEAkN7Fh1WqlIXaqgH_JRfN3W7XWKG2TyqZRi_OBW_0jILA2kaoQ2SSAvWUeuuoQxbaW7Q90VlSmfhWYx2fgtTX4JS2Hb0X2tvDyvvlYbTndLm_mtGSa4s Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:35:36.773189 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:35:36.774772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d6ee89cb464afa95e222b2a1e7279b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d6ee89cb464afa95e222b2a1e7279b"}]}] Oct 04 03:35:36.774772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:36.774772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:36.774772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:36.774772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:36.774772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:35:36.774772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:35:36.774772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: b8795829c34046628cae345dd4d45e75 Oct 04 03:35:36.774772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:36.774772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:35:36.774772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:36.774772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '4d704ae4-024f-4f05-8c08-2853b755b031'} Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:35:36.776159 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. Oct 04 03:35:36.778020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:36.779660 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0bf11828-04f3-4fb9-a892-0b8b6574e2f8 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Returning 404 to user: Instance 4d704ae4-024f-4f05-8c08-2853b755b031 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:35:36.779660 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0bf11828-04f3-4fb9-a892-0b8b6574e2f8 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031" status: 404 len: 111 microversion: 2.1 time: 0.034351 Oct 04 03:35:36.779660 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 387/768] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:36 2022] GET /compute/v2.1/servers/4d704ae4-024f-4f05-8c08-2853b755b031 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:35:37.919278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-711e1711-48d4-47f1-a485-0b8a8073d30f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:37.919879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-711e1711-48d4-47f1-a485-0b8a8073d30f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:37.926146 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-711e1711-48d4-47f1-a485-0b8a8073d30f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:37.926620 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-711e1711-48d4-47f1-a485-0b8a8073d30f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:37.927122 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-711e1711-48d4-47f1-a485-0b8a8073d30f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:37.927844 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-711e1711-48d4-47f1-a485-0b8a8073d30f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:37.928466 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-711e1711-48d4-47f1-a485-0b8a8073d30f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:37.928982 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-711e1711-48d4-47f1-a485-0b8a8073d30f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:37.944320 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-711e1711-48d4-47f1-a485-0b8a8073d30f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] HTTP exception thrown: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-711e1711-48d4-47f1-a485-0b8a8073d30f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Request method failure captured: Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: DELETE /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b HTTP/1.1 Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6isUYhgYsAb2pqxJ5i2_6gzGtKyJzLe2quMbLKiFrXtrxQIhaAv2XwsUqEAkN7Fh1WqlIXaqgH_JRfN3W7XWKG2TyqZRi_OBW_0jILA2kaoQ2SSAvWUeuuoQxbaW7Q90VlSmfhWYx2fgtTX4JS2Hb0X2tvDyvvlYbTndLm_mtGSa4s Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:35:37.945848 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:35:37.947161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d6ee89cb464afa95e222b2a1e7279b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d6ee89cb464afa95e222b2a1e7279b"}]}] Oct 04 03:35:37.947161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:37.947161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:37.947161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:37.947161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:37.947161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:35:37.947161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:35:37.947161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: b8795829c34046628cae345dd4d45e75 Oct 04 03:35:37.947161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:37.947161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:35:37.947161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:35:37.947161 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': 'fa285589-057b-4a56-9da5-614e561bb64b'} Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:35:37.951006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:35:37.952462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:37.953936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-711e1711-48d4-47f1-a485-0b8a8073d30f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Returning 404 to user: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:35:37.953936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-711e1711-48d4-47f1-a485-0b8a8073d30f tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 404 len: 111 microversion: 2.1 time: 0.032871 Oct 04 03:35:37.953936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 382/769] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:35:37 2022] DELETE /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:35:37.955850 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c0394399-a016-46d2-bfb9-22f22afdd24d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:37.956390 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c0394399-a016-46d2-bfb9-22f22afdd24d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: fa285589-057b-4a56-9da5-614e561bb64b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:37.962771 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0394399-a016-46d2-bfb9-22f22afdd24d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:37.963113 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0394399-a016-46d2-bfb9-22f22afdd24d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:37.963833 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0394399-a016-46d2-bfb9-22f22afdd24d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:37.964851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0394399-a016-46d2-bfb9-22f22afdd24d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:37.965641 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0394399-a016-46d2-bfb9-22f22afdd24d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:37.965902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0394399-a016-46d2-bfb9-22f22afdd24d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:37.993738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-c0394399-a016-46d2-bfb9-22f22afdd24d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] HTTP exception thrown: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c0394399-a016-46d2-bfb9-22f22afdd24d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Request method failure captured: Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b HTTP/1.1 Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6isUYhgYsAb2pqxJ5i2_6gzGtKyJzLe2quMbLKiFrXtrxQIhaAv2XwsUqEAkN7Fh1WqlIXaqgH_JRfN3W7XWKG2TyqZRi_OBW_0jILA2kaoQ2SSAvWUeuuoQxbaW7Q90VlSmfhWYx2fgtTX4JS2Hb0X2tvDyvvlYbTndLm_mtGSa4s Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:35:37.996085 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:35:37.998019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d6ee89cb464afa95e222b2a1e7279b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d6ee89cb464afa95e222b2a1e7279b"}]}] Oct 04 03:35:37.998019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:37.998019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:37.998019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:37.998019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:37.998019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:35:37.998019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:35:37.998019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: b8795829c34046628cae345dd4d45e75 Oct 04 03:35:37.998019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:37.998019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:35:37.998019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:35:37.998019 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': 'fa285589-057b-4a56-9da5-614e561bb64b'} Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:35:37.998886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. Oct 04 03:35:38.000334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:38.002267 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c0394399-a016-46d2-bfb9-22f22afdd24d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Returning 404 to user: Instance fa285589-057b-4a56-9da5-614e561bb64b could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:35:38.003108 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c0394399-a016-46d2-bfb9-22f22afdd24d tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b" status: 404 len: 111 microversion: 2.1 time: 0.051258 Oct 04 03:35:38.004020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 388/770] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:37 2022] GET /compute/v2.1/servers/fa285589-057b-4a56-9da5-614e561bb64b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:35:38.012361 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-db7e761a-78ad-4568-a7f5-f93a76a6dd35 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:38.012953 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-db7e761a-78ad-4568-a7f5-f93a76a6dd35 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:38.018937 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-db7e761a-78ad-4568-a7f5-f93a76a6dd35 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:38.019429 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-db7e761a-78ad-4568-a7f5-f93a76a6dd35 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:38.019918 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-db7e761a-78ad-4568-a7f5-f93a76a6dd35 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:38.020620 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-db7e761a-78ad-4568-a7f5-f93a76a6dd35 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:38.021076 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-db7e761a-78ad-4568-a7f5-f93a76a6dd35 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:38.021500 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-db7e761a-78ad-4568-a7f5-f93a76a6dd35 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:38.036989 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-db7e761a-78ad-4568-a7f5-f93a76a6dd35 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] HTTP exception thrown: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-db7e761a-78ad-4568-a7f5-f93a76a6dd35 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Request method failure captured: Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: DELETE /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d HTTP/1.1 Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6isUYhgYsAb2pqxJ5i2_6gzGtKyJzLe2quMbLKiFrXtrxQIhaAv2XwsUqEAkN7Fh1WqlIXaqgH_JRfN3W7XWKG2TyqZRi_OBW_0jILA2kaoQ2SSAvWUeuuoQxbaW7Q90VlSmfhWYx2fgtTX4JS2Hb0X2tvDyvvlYbTndLm_mtGSa4s Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:35:38.038598 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:35:38.039954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d6ee89cb464afa95e222b2a1e7279b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d6ee89cb464afa95e222b2a1e7279b"}]}] Oct 04 03:35:38.039954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:38.039954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:38.039954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:38.039954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:38.039954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:35:38.039954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:35:38.039954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: b8795829c34046628cae345dd4d45e75 Oct 04 03:35:38.039954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:38.039954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:35:38.039954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:35:38.039954 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '86a755ac-b03d-459e-ae14-f1242058a16d'} Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:35:38.040713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:35:38.041936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:38.044522 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-db7e761a-78ad-4568-a7f5-f93a76a6dd35 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Returning 404 to user: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:35:38.044522 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-db7e761a-78ad-4568-a7f5-f93a76a6dd35 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 404 len: 111 microversion: 2.1 time: 0.032080 Oct 04 03:35:38.044522 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 383/771] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:35:38 2022] DELETE /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 03:35:38.048999 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6766f1f1-e3db-429a-8ce2-7886e9916aaa tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:38.049608 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6766f1f1-e3db-429a-8ce2-7886e9916aaa tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 86a755ac-b03d-459e-ae14-f1242058a16d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:38.055958 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6766f1f1-e3db-429a-8ce2-7886e9916aaa tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:38.056185 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6766f1f1-e3db-429a-8ce2-7886e9916aaa tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:38.056431 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6766f1f1-e3db-429a-8ce2-7886e9916aaa tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:38.057136 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6766f1f1-e3db-429a-8ce2-7886e9916aaa tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:38.057586 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6766f1f1-e3db-429a-8ce2-7886e9916aaa tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:38.058461 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6766f1f1-e3db-429a-8ce2-7886e9916aaa tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:38.075333 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-6766f1f1-e3db-429a-8ce2-7886e9916aaa tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] HTTP exception thrown: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6766f1f1-e3db-429a-8ce2-7886e9916aaa tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Request method failure captured: Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d HTTP/1.1 Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6isUYhgYsAb2pqxJ5i2_6gzGtKyJzLe2quMbLKiFrXtrxQIhaAv2XwsUqEAkN7Fh1WqlIXaqgH_JRfN3W7XWKG2TyqZRi_OBW_0jILA2kaoQ2SSAvWUeuuoQxbaW7Q90VlSmfhWYx2fgtTX4JS2Hb0X2tvDyvvlYbTndLm_mtGSa4s Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:35:38.076891 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:35:38.078260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d6ee89cb464afa95e222b2a1e7279b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d6ee89cb464afa95e222b2a1e7279b"}]}] Oct 04 03:35:38.078260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:38.078260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:38.078260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:38.078260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:38.078260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:35:38.078260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:35:38.078260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: b8795829c34046628cae345dd4d45e75 Oct 04 03:35:38.078260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:38.078260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:35:38.078260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:35:38.078260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '86a755ac-b03d-459e-ae14-f1242058a16d'} Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:35:38.078972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. Oct 04 03:35:38.080176 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:38.081813 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6766f1f1-e3db-429a-8ce2-7886e9916aaa tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Returning 404 to user: Instance 86a755ac-b03d-459e-ae14-f1242058a16d could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:35:38.081813 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6766f1f1-e3db-429a-8ce2-7886e9916aaa tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d" status: 404 len: 111 microversion: 2.1 time: 0.033076 Oct 04 03:35:38.081813 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 389/772] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:38 2022] GET /compute/v2.1/servers/86a755ac-b03d-459e-ae14-f1242058a16d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:35:39.248081 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-dbfda2d1-ca5a-49e5-b175-462c380424a1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:39.249840 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-dbfda2d1-ca5a-49e5-b175-462c380424a1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:39.257423 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dbfda2d1-ca5a-49e5-b175-462c380424a1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:39.257905 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dbfda2d1-ca5a-49e5-b175-462c380424a1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:39.258358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dbfda2d1-ca5a-49e5-b175-462c380424a1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:39.259043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dbfda2d1-ca5a-49e5-b175-462c380424a1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:39.259500 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dbfda2d1-ca5a-49e5-b175-462c380424a1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:39.259929 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dbfda2d1-ca5a-49e5-b175-462c380424a1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:39.273322 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-dbfda2d1-ca5a-49e5-b175-462c380424a1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] HTTP exception thrown: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-dbfda2d1-ca5a-49e5-b175-462c380424a1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Request method failure captured: Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: DELETE /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 HTTP/1.1 Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6isUYhgYsAb2pqxJ5i2_6gzGtKyJzLe2quMbLKiFrXtrxQIhaAv2XwsUqEAkN7Fh1WqlIXaqgH_JRfN3W7XWKG2TyqZRi_OBW_0jILA2kaoQ2SSAvWUeuuoQxbaW7Q90VlSmfhWYx2fgtTX4JS2Hb0X2tvDyvvlYbTndLm_mtGSa4s Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:35:39.274828 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:35:39.276229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d6ee89cb464afa95e222b2a1e7279b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d6ee89cb464afa95e222b2a1e7279b"}]}] Oct 04 03:35:39.276229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:39.276229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:39.276229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:39.276229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:39.276229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:35:39.276229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:35:39.276229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: b8795829c34046628cae345dd4d45e75 Oct 04 03:35:39.276229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:39.276229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:35:39.276229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:35:39.276229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '79803288-b24a-4fcd-9ed9-b08111250cc5'} Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:35:39.277502 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:35:39.278749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:35:39.280003 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-dbfda2d1-ca5a-49e5-b175-462c380424a1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Returning 404 to user: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:35:39.280003 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-dbfda2d1-ca5a-49e5-b175-462c380424a1 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 404 len: 111 microversion: 2.1 time: 0.032670 Oct 04 03:35:39.280003 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 384/773] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:35:39 2022] DELETE /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:35:39.285742 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-41c63322-d8c4-4627-87e2-67d89f2b6601 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:35:39.286257 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-41c63322-d8c4-4627-87e2-67d89f2b6601 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] [instance: 79803288-b24a-4fcd-9ed9-b08111250cc5] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:35:39.293273 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41c63322-d8c4-4627-87e2-67d89f2b6601 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:39.293870 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41c63322-d8c4-4627-87e2-67d89f2b6601 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:39.294301 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41c63322-d8c4-4627-87e2-67d89f2b6601 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:39.295004 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41c63322-d8c4-4627-87e2-67d89f2b6601 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:35:39.295426 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41c63322-d8c4-4627-87e2-67d89f2b6601 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:35:39.295872 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41c63322-d8c4-4627-87e2-67d89f2b6601 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:35:39.312317 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-41c63322-d8c4-4627-87e2-67d89f2b6601 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] HTTP exception thrown: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-41c63322-d8c4-4627-87e2-67d89f2b6601 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Request method failure captured: Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 HTTP/1.1 Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6isUYhgYsAb2pqxJ5i2_6gzGtKyJzLe2quMbLKiFrXtrxQIhaAv2XwsUqEAkN7Fh1WqlIXaqgH_JRfN3W7XWKG2TyqZRi_OBW_0jILA2kaoQ2SSAvWUeuuoQxbaW7Q90VlSmfhWYx2fgtTX4JS2Hb0X2tvDyvvlYbTndLm_mtGSa4s Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:35:39.313826 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:35:39.315104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a8d6ee89cb464afa95e222b2a1e7279b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a8d6ee89cb464afa95e222b2a1e7279b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a8d6ee89cb464afa95e222b2a1e7279b"}]}] Oct 04 03:35:39.315104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:39.315104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: a8d6ee89cb464afa95e222b2a1e7279b Oct 04 03:35:39.315104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-946894044 Oct 04 03:35:39.315104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:39.315104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:35:39.315104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:35:39.315104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: b8795829c34046628cae345dd4d45e75 Oct 04 03:35:39.315104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-946894044-project Oct 04 03:35:39.315104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:35:39.315104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:35:39.315104 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '79803288-b24a-4fcd-9ed9-b08111250cc5'} Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:35:39.316247 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. Oct 04 03:35:39.317954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:35:39.319827 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-41c63322-d8c4-4627-87e2-67d89f2b6601 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] Returning 404 to user: Instance 79803288-b24a-4fcd-9ed9-b08111250cc5 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:35:39.319827 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-41c63322-d8c4-4627-87e2-67d89f2b6601 tempest-AttachVolumeNegativeTest-946894044 tempest-AttachVolumeNegativeTest-946894044-project] 10.222.0.25 "GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5" status: 404 len: 111 microversion: 2.1 time: 0.033530 Oct 04 03:35:39.319827 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 390/774] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:35:39 2022] GET /compute/v2.1/servers/79803288-b24a-4fcd-9ed9-b08111250cc5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:36:08.619369 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-184179ce-eabf-4222-870f-02614971c5b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:08.622050 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-184179ce-eabf-4222-870f-02614971c5b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:08.625796 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:08.626564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:08.633026 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-184179ce-eabf-4222-870f-02614971c5b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:08.634366 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-184179ce-eabf-4222-870f-02614971c5b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:08.634966 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-184179ce-eabf-4222-870f-02614971c5b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:08.639538 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-184179ce-eabf-4222-870f-02614971c5b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:08.640195 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-184179ce-eabf-4222-870f-02614971c5b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:08.640991 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-184179ce-eabf-4222-870f-02614971c5b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:08.678854 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-184179ce-eabf-4222-870f-02614971c5b7 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.063291 Oct 04 03:36:08.679865 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 385/775] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Oct 4 03:36:08 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:08.752788 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4f364534-0a69-4fbb-ac58-6148786f7546 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:08.754642 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4f364534-0a69-4fbb-ac58-6148786f7546 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:08.765195 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:08.766184 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:08.769416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4f364534-0a69-4fbb-ac58-6148786f7546 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:08.770277 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4f364534-0a69-4fbb-ac58-6148786f7546 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:08.771127 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4f364534-0a69-4fbb-ac58-6148786f7546 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:08.772199 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4f364534-0a69-4fbb-ac58-6148786f7546 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:08.773008 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4f364534-0a69-4fbb-ac58-6148786f7546 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:08.774393 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4f364534-0a69-4fbb-ac58-6148786f7546 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:08.831282 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4f364534-0a69-4fbb-ac58-6148786f7546 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:36:08.914883 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4f364534-0a69-4fbb-ac58-6148786f7546 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 204 len: 0 microversion: 2.20 time: 0.167483 Oct 04 03:36:08.915753 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 391/776] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Oct 4 03:36:08 2022] DELETE /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 03:36:08.925316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-38a4f2dc-6e65-4e82-8bde-b692d72c5bdf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:08.926014 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-38a4f2dc-6e65-4e82-8bde-b692d72c5bdf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:08.933860 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-38a4f2dc-6e65-4e82-8bde-b692d72c5bdf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:08.934756 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-38a4f2dc-6e65-4e82-8bde-b692d72c5bdf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:08.935456 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-38a4f2dc-6e65-4e82-8bde-b692d72c5bdf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:08.936365 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-38a4f2dc-6e65-4e82-8bde-b692d72c5bdf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:08.937165 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-38a4f2dc-6e65-4e82-8bde-b692d72c5bdf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:08.937752 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-38a4f2dc-6e65-4e82-8bde-b692d72c5bdf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:09.106580 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-38a4f2dc-6e65-4e82-8bde-b692d72c5bdf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:09.114814 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-38a4f2dc-6e65-4e82-8bde-b692d72c5bdf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:09.116521 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-38a4f2dc-6e65-4e82-8bde-b692d72c5bdf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:09.117914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-38a4f2dc-6e65-4e82-8bde-b692d72c5bdf tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.196860 Oct 04 03:36:09.118902 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 386/777] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:36:08 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:36:10.146976 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a1cd413a-75bf-4c30-991e-be55cedfa35f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:10.148036 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a1cd413a-75bf-4c30-991e-be55cedfa35f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:10.155645 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1cd413a-75bf-4c30-991e-be55cedfa35f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:10.156273 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1cd413a-75bf-4c30-991e-be55cedfa35f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:10.156782 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1cd413a-75bf-4c30-991e-be55cedfa35f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:10.157715 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1cd413a-75bf-4c30-991e-be55cedfa35f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:10.158243 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1cd413a-75bf-4c30-991e-be55cedfa35f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:10.158736 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a1cd413a-75bf-4c30-991e-be55cedfa35f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:10.433102 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a1cd413a-75bf-4c30-991e-be55cedfa35f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:10.446948 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a1cd413a-75bf-4c30-991e-be55cedfa35f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:10.449734 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a1cd413a-75bf-4c30-991e-be55cedfa35f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:10.451637 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a1cd413a-75bf-4c30-991e-be55cedfa35f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1721 microversion: 2.20 time: 0.309075 Oct 04 03:36:10.470395 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 392/778] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:36:10 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1721 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:36:11.479524 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-459edf52-754c-4640-b3f4-f53991d4584f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:11.480303 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-459edf52-754c-4640-b3f4-f53991d4584f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:11.489826 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-459edf52-754c-4640-b3f4-f53991d4584f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:11.492998 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-459edf52-754c-4640-b3f4-f53991d4584f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:11.494517 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-459edf52-754c-4640-b3f4-f53991d4584f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:11.497226 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-459edf52-754c-4640-b3f4-f53991d4584f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:11.497985 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-459edf52-754c-4640-b3f4-f53991d4584f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:11.498911 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-459edf52-754c-4640-b3f4-f53991d4584f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:11.672384 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-459edf52-754c-4640-b3f4-f53991d4584f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:11.704104 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-459edf52-754c-4640-b3f4-f53991d4584f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:11.706810 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-459edf52-754c-4640-b3f4-f53991d4584f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '542b137fb8cd4d25867d95a13d2cb651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96643b79b7724c398b1df29f9ea0bbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:11.709631 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-459edf52-754c-4640-b3f4-f53991d4584f tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 200 len: 1654 microversion: 2.20 time: 0.235391 Oct 04 03:36:11.714089 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 387/779] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:36:11 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 1654 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 03:36:11.825829 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-a4aaeda6-72a6-46cd-9914-f776a7a0131c req-f7ebc8d7-21bc-4bfe-9d15-11a41408cd41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528cda6-7d7e-4973-b37c-bcfccbd9351d", "name": "network-vif-deleted", "tag": "f9bf7419-15c5-4815-98c4-9e6466299270"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:36:11.849220 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-a4aaeda6-72a6-46cd-9914-f776a7a0131c req-f7ebc8d7-21bc-4bfe-9d15-11a41408cd41 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:11.851997 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-a4aaeda6-72a6-46cd-9914-f776a7a0131c req-f7ebc8d7-21bc-4bfe-9d15-11a41408cd41 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:11.855053 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-a4aaeda6-72a6-46cd-9914-f776a7a0131c req-f7ebc8d7-21bc-4bfe-9d15-11a41408cd41 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:11.888858 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-a4aaeda6-72a6-46cd-9914-f776a7a0131c req-f7ebc8d7-21bc-4bfe-9d15-11a41408cd41 service nova] Creating event network-vif-deleted:f9bf7419-15c5-4815-98c4-9e6466299270 for instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d on hv-cinder-84914 Oct 04 03:36:11.901717 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-a4aaeda6-72a6-46cd-9914-f776a7a0131c req-f7ebc8d7-21bc-4bfe-9d15-11a41408cd41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082344 Oct 04 03:36:11.903889 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 393/780] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:36:12.742978 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-cbb2f0dc-223d-4440-b11a-0598c58dda9d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:12.743617 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-cbb2f0dc-223d-4440-b11a-0598c58dda9d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:12.759729 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cbb2f0dc-223d-4440-b11a-0598c58dda9d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:12.760222 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cbb2f0dc-223d-4440-b11a-0598c58dda9d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:12.760656 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cbb2f0dc-223d-4440-b11a-0598c58dda9d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:12.767469 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cbb2f0dc-223d-4440-b11a-0598c58dda9d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:12.767981 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cbb2f0dc-223d-4440-b11a-0598c58dda9d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:12.768423 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cbb2f0dc-223d-4440-b11a-0598c58dda9d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:12.798259 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-cbb2f0dc-223d-4440-b11a-0598c58dda9d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] HTTP exception thrown: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-cbb2f0dc-223d-4440-b11a-0598c58dda9d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Request method failure captured: Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d HTTP/1.1 Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6ih4h6XX68iKzuuSj1ucm6Lfc1S4xbbk_ttwNyYtNAwImXdILd340Px5C-UXJjLIofleuW5nKBdQRIqpo21J6-J7gAtwXrJJdYWeFuoECfIFXsRxy0j2IMN6r4zpnHWD1sWuHIgQZ9iD4CadAZCe4FH-sRHO-ZeZC0niBSKO4TjlYg Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 96643b79b7724c398b1df29f9ea0bbd4 Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:36:12.802212 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:36:12.803790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96643b79b7724c398b1df29f9ea0bbd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96643b79b7724c398b1df29f9ea0bbd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_96643b79b7724c398b1df29f9ea0bbd4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/96643b79b7724c398b1df29f9ea0bbd4"}]}] Oct 04 03:36:12.803790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:12.803790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 96643b79b7724c398b1df29f9ea0bbd4 Oct 04 03:36:12.803790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:12.803790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-AttachVolumeShelveTestJSON-131436698-project Oct 04 03:36:12.803790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:36:12.803790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:36:12.803790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 542b137fb8cd4d25867d95a13d2cb651 Oct 04 03:36:12.803790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-131436698-project Oct 04 03:36:12.803790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:36:12.803790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:12.803790 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '8528cda6-7d7e-4973-b37c-bcfccbd9351d'} Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:36:12.804564 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:12.805869 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:12.807008 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-cbb2f0dc-223d-4440-b11a-0598c58dda9d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Returning 404 to user: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:36:12.807008 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-cbb2f0dc-223d-4440-b11a-0598c58dda9d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 404 len: 111 microversion: 2.20 time: 0.065191 Oct 04 03:36:12.810551 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 388/781] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:36:12 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 03:36:12.816275 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ac7c77c3-61f0-46a3-820b-f04edf8dd034 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '.version_select at 0x7f165b438af0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:12.864530 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ac7c77c3-61f0-46a3-820b-f04edf8dd034 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2129873305" status: 204 len: 0 microversion: 2.20 time: 0.052350 Oct 04 03:36:12.867143 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 394/782] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Oct 4 03:36:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2129873305 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 03:36:15.516343 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2d159ea8-ea77-427a-a75f-b14325a8342d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:15.516857 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-2d159ea8-ea77-427a-a75f-b14325a8342d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:15.523055 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d159ea8-ea77-427a-a75f-b14325a8342d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:15.523832 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d159ea8-ea77-427a-a75f-b14325a8342d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:15.524006 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d159ea8-ea77-427a-a75f-b14325a8342d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:15.524696 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d159ea8-ea77-427a-a75f-b14325a8342d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:15.525150 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d159ea8-ea77-427a-a75f-b14325a8342d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:15.525573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2d159ea8-ea77-427a-a75f-b14325a8342d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:15.540135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-2d159ea8-ea77-427a-a75f-b14325a8342d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] HTTP exception thrown: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2d159ea8-ea77-427a-a75f-b14325a8342d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Request method failure captured: Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: DELETE /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d HTTP/1.1 Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6ih4h6XX68iKzuuSj1ucm6Lfc1S4xbbk_ttwNyYtNAwImXdILd340Px5C-UXJjLIofleuW5nKBdQRIqpo21J6-J7gAtwXrJJdYWeFuoECfIFXsRxy0j2IMN6r4zpnHWD1sWuHIgQZ9iD4CadAZCe4FH-sRHO-ZeZC0niBSKO4TjlYg Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 96643b79b7724c398b1df29f9ea0bbd4 Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:36:15.541682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:36:15.543872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96643b79b7724c398b1df29f9ea0bbd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96643b79b7724c398b1df29f9ea0bbd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_96643b79b7724c398b1df29f9ea0bbd4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/96643b79b7724c398b1df29f9ea0bbd4"}]}] Oct 04 03:36:15.543872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:15.543872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 96643b79b7724c398b1df29f9ea0bbd4 Oct 04 03:36:15.543872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:15.543872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-AttachVolumeShelveTestJSON-131436698-project Oct 04 03:36:15.543872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:36:15.543872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:36:15.543872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 542b137fb8cd4d25867d95a13d2cb651 Oct 04 03:36:15.543872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-131436698-project Oct 04 03:36:15.543872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:36:15.543872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:15.543872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '8528cda6-7d7e-4973-b37c-bcfccbd9351d'} Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:36:15.544678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:15.545873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:15.547062 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2d159ea8-ea77-427a-a75f-b14325a8342d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Returning 404 to user: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:36:15.547062 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2d159ea8-ea77-427a-a75f-b14325a8342d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 404 len: 111 microversion: 2.20 time: 0.031082 Oct 04 03:36:15.547062 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 389/783] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Oct 4 03:36:15 2022] DELETE /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 03:36:15.552592 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-989e5d43-4c71-4c34-944e-0d34ab3f4b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:15.553322 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-989e5d43-4c71-4c34-944e-0d34ab3f4b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: 8528cda6-7d7e-4973-b37c-bcfccbd9351d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:15.561676 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-989e5d43-4c71-4c34-944e-0d34ab3f4b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:15.562360 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-989e5d43-4c71-4c34-944e-0d34ab3f4b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:15.562796 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-989e5d43-4c71-4c34-944e-0d34ab3f4b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:15.563514 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-989e5d43-4c71-4c34-944e-0d34ab3f4b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:15.564105 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-989e5d43-4c71-4c34-944e-0d34ab3f4b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:15.564528 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-989e5d43-4c71-4c34-944e-0d34ab3f4b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:15.584321 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-989e5d43-4c71-4c34-944e-0d34ab3f4b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] HTTP exception thrown: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-989e5d43-4c71-4c34-944e-0d34ab3f4b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Request method failure captured: Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d HTTP/1.1 Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6ih4h6XX68iKzuuSj1ucm6Lfc1S4xbbk_ttwNyYtNAwImXdILd340Px5C-UXJjLIofleuW5nKBdQRIqpo21J6-J7gAtwXrJJdYWeFuoECfIFXsRxy0j2IMN6r4zpnHWD1sWuHIgQZ9iD4CadAZCe4FH-sRHO-ZeZC0niBSKO4TjlYg Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: 96643b79b7724c398b1df29f9ea0bbd4 Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:36:15.586165 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:36:15.587652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96643b79b7724c398b1df29f9ea0bbd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96643b79b7724c398b1df29f9ea0bbd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_96643b79b7724c398b1df29f9ea0bbd4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/96643b79b7724c398b1df29f9ea0bbd4"}]}] Oct 04 03:36:15.587652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:15.587652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: 96643b79b7724c398b1df29f9ea0bbd4 Oct 04 03:36:15.587652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:15.587652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-AttachVolumeShelveTestJSON-131436698-project Oct 04 03:36:15.587652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:36:15.587652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:36:15.587652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: 542b137fb8cd4d25867d95a13d2cb651 Oct 04 03:36:15.587652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeShelveTestJSON-131436698-project Oct 04 03:36:15.587652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:36:15.587652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:15.587652 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '8528cda6-7d7e-4973-b37c-bcfccbd9351d'} Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:36:15.588417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. Oct 04 03:36:15.589879 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:36:15.592450 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-989e5d43-4c71-4c34-944e-0d34ab3f4b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Returning 404 to user: Instance 8528cda6-7d7e-4973-b37c-bcfccbd9351d could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:36:15.593533 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-989e5d43-4c71-4c34-944e-0d34ab3f4b1d tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d" status: 404 len: 111 microversion: 2.20 time: 0.045198 Oct 04 03:36:15.594312 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 395/784] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:36:15 2022] GET /compute/v2.1/servers/8528cda6-7d7e-4973-b37c-bcfccbd9351d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 03:36:16.752530 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-8569606b-e607-4f11-bfb0-79c9e063c506 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:16.753758 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-8569606b-e607-4f11-bfb0-79c9e063c506 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:16.763966 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8569606b-e607-4f11-bfb0-79c9e063c506 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:16.764823 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8569606b-e607-4f11-bfb0-79c9e063c506 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:16.765752 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8569606b-e607-4f11-bfb0-79c9e063c506 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:16.766665 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8569606b-e607-4f11-bfb0-79c9e063c506 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:16.767323 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8569606b-e607-4f11-bfb0-79c9e063c506 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:16.768053 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-8569606b-e607-4f11-bfb0-79c9e063c506 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:16.784145 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-8569606b-e607-4f11-bfb0-79c9e063c506 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] HTTP exception thrown: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-8569606b-e607-4f11-bfb0-79c9e063c506 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Request method failure captured: Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: DELETE /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 HTTP/1.1 Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6ih4h6XX68iKzuuSj1ucm6Lfc1S4xbbk_ttwNyYtNAwImXdILd340Px5C-UXJjLIofleuW5nKBdQRIqpo21J6-J7gAtwXrJJdYWeFuoECfIFXsRxy0j2IMN6r4zpnHWD1sWuHIgQZ9iD4CadAZCe4FH-sRHO-ZeZC0niBSKO4TjlYg Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: 96643b79b7724c398b1df29f9ea0bbd4 Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:36:16.785863 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:36:16.787537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96643b79b7724c398b1df29f9ea0bbd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96643b79b7724c398b1df29f9ea0bbd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_96643b79b7724c398b1df29f9ea0bbd4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/96643b79b7724c398b1df29f9ea0bbd4"}]}] Oct 04 03:36:16.787537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:16.787537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: 96643b79b7724c398b1df29f9ea0bbd4 Oct 04 03:36:16.787537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:16.787537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-AttachVolumeShelveTestJSON-131436698-project Oct 04 03:36:16.787537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:36:16.787537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:36:16.787537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 542b137fb8cd4d25867d95a13d2cb651 Oct 04 03:36:16.787537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-131436698-project Oct 04 03:36:16.787537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:36:16.787537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:36:16.787537 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': 'f680f852-0ad9-4478-912f-1821b7755927'} Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:36:16.788458 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:36:16.789861 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:36:16.791295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-8569606b-e607-4f11-bfb0-79c9e063c506 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Returning 404 to user: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:36:16.791295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-8569606b-e607-4f11-bfb0-79c9e063c506 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 404 len: 111 microversion: 2.20 time: 0.041561 Oct 04 03:36:16.791295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 390/785] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Oct 4 03:36:16 2022] DELETE /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 03:36:16.798152 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d045c70f-e98b-44df-8b4f-32196aa342c1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:16.798760 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d045c70f-e98b-44df-8b4f-32196aa342c1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] [instance: f680f852-0ad9-4478-912f-1821b7755927] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:16.805607 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d045c70f-e98b-44df-8b4f-32196aa342c1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:16.806097 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d045c70f-e98b-44df-8b4f-32196aa342c1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:16.806586 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d045c70f-e98b-44df-8b4f-32196aa342c1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:16.807479 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d045c70f-e98b-44df-8b4f-32196aa342c1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:16.808864 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d045c70f-e98b-44df-8b4f-32196aa342c1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:16.809603 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d045c70f-e98b-44df-8b4f-32196aa342c1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:16.824711 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-d045c70f-e98b-44df-8b4f-32196aa342c1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] HTTP exception thrown: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d045c70f-e98b-44df-8b4f-32196aa342c1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Request method failure captured: Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 HTTP/1.1 Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6ih4h6XX68iKzuuSj1ucm6Lfc1S4xbbk_ttwNyYtNAwImXdILd340Px5C-UXJjLIofleuW5nKBdQRIqpo21J6-J7gAtwXrJJdYWeFuoECfIFXsRxy0j2IMN6r4zpnHWD1sWuHIgQZ9iD4CadAZCe4FH-sRHO-ZeZC0niBSKO4TjlYg Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: 96643b79b7724c398b1df29f9ea0bbd4 Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:36:16.826279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:36:16.828024 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96643b79b7724c398b1df29f9ea0bbd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/96643b79b7724c398b1df29f9ea0bbd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_96643b79b7724c398b1df29f9ea0bbd4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/96643b79b7724c398b1df29f9ea0bbd4"}]}] Oct 04 03:36:16.828024 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:16.828024 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: 96643b79b7724c398b1df29f9ea0bbd4 Oct 04 03:36:16.828024 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-131436698 Oct 04 03:36:16.828024 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-AttachVolumeShelveTestJSON-131436698-project Oct 04 03:36:16.828024 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:36:16.828024 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:36:16.828024 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: 542b137fb8cd4d25867d95a13d2cb651 Oct 04 03:36:16.828024 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeShelveTestJSON-131436698-project Oct 04 03:36:16.828024 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:36:16.828024 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:36:16.828024 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': 'f680f852-0ad9-4478-912f-1821b7755927'} Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:36:16.828943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. Oct 04 03:36:16.830366 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:36:16.832413 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d045c70f-e98b-44df-8b4f-32196aa342c1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] Returning 404 to user: Instance f680f852-0ad9-4478-912f-1821b7755927 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:36:16.833719 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d045c70f-e98b-44df-8b4f-32196aa342c1 tempest-AttachVolumeShelveTestJSON-131436698 tempest-AttachVolumeShelveTestJSON-131436698-project] 10.222.0.25 "GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927" status: 404 len: 111 microversion: 2.20 time: 0.039173 Oct 04 03:36:16.834581 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 396/786] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Oct 4 03:36:16 2022] GET /compute/v2.1/servers/f680f852-0ad9-4478-912f-1821b7755927 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 03:36:33.773140 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7f0b2a11-d6fe-4c8c-bdcb-07befa93ee8c tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Action: 'create', calling method: .version_select at 0x7f165b734550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1241954653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiHcWpuDQ0CRRt5LAv3GMJiD/TV7aANohzuBNKrAKip/1jWlBDgvDBdM5by+GJypA+fn5Zr+iEfhTCzGvp5FPFyrcPqzrlJa33gunR+pQ78IzbnnfBJpTnwzFnIDaLldA=="}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:36:33.784587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=12 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:33.784587 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=24 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:33.796847 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-7f0b2a11-d6fe-4c8c-bdcb-07befa93ee8c tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Getting quotas for project b3442e6424b9446c90d15225faa9553f. Resources: {'key_pairs'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:36:33.803081 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-7f0b2a11-d6fe-4c8c-bdcb-07befa93ee8c tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Getting quotas for user 926111af89d943a597ec28264b1ef026 and project b3442e6424b9446c90d15225faa9553f. Resources: {'key_pairs'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:36:33.832018 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-7f0b2a11-d6fe-4c8c-bdcb-07befa93ee8c tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062781 Oct 04 03:36:33.832607 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 391/787] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Oct 4 03:36:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:36:33.934386 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-928045266", "imageRef": "cb77ad23-3db4-4130-b74d-3474891ddca9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1241954653", "networks": [{"uuid": "5e531e13-3453-42cc-b32a-b3af1ad3ce68"}]}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:36:33.943079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:33.943778 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:33.990204 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] validate_networks() for [('5e531e13-3453-42cc-b32a-b3af1ad3ce68', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:36:34.458094 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:36:34.458509 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:36:34.458971 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:36:34.459368 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:36:34.459792 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:36:34.470911 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:34.470911 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:34.470911 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:34.471387 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:34.471871 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:34.472295 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:34.489633 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Getting quotas for project b3442e6424b9446c90d15225faa9553f. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:36:34.493594 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Getting quotas for user 926111af89d943a597ec28264b1ef026 and project b3442e6424b9446c90d15225faa9553f. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:36:34.504761 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:36:34.506990 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb77ad23-3db4-4130-b74d-3474891ddca9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:36:34.553310 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5efaa735-2e0a-4a03-9109-9e0ffbb95bee tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623219 Oct 04 03:36:34.554071 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 397/788] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:36:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 03:36:34.565993 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e3c7001b-597d-484b-8cd4-761de518bb4d tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:34.566998 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e3c7001b-597d-484b-8cd4-761de518bb4d tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:34.629686 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e3c7001b-597d-484b-8cd4-761de518bb4d tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:34.641641 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e3c7001b-597d-484b-8cd4-761de518bb4d tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1258 microversion: 2.1 time: 0.079631 Oct 04 03:36:34.648617 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 392/789] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:34 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:36:35.676415 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ed35edd4-670d-43e7-ab37-479e1bbfe232 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:35.677026 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ed35edd4-670d-43e7-ab37-479e1bbfe232 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:35.685456 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed35edd4-670d-43e7-ab37-479e1bbfe232 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:35.685954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed35edd4-670d-43e7-ab37-479e1bbfe232 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:35.686424 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed35edd4-670d-43e7-ab37-479e1bbfe232 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:35.687131 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed35edd4-670d-43e7-ab37-479e1bbfe232 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:35.687611 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed35edd4-670d-43e7-ab37-479e1bbfe232 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:35.688398 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed35edd4-670d-43e7-ab37-479e1bbfe232 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:35.767962 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ed35edd4-670d-43e7-ab37-479e1bbfe232 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:35.775557 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ed35edd4-670d-43e7-ab37-479e1bbfe232 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1328 microversion: 2.1 time: 0.105705 Oct 04 03:36:35.776456 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 398/790] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:35 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:36.798936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-29a615f6-0142-405d-a2ea-df3423758c37 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:36.800259 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-29a615f6-0142-405d-a2ea-df3423758c37 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:36.807308 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-29a615f6-0142-405d-a2ea-df3423758c37 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:36.809034 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-29a615f6-0142-405d-a2ea-df3423758c37 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:36.809704 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-29a615f6-0142-405d-a2ea-df3423758c37 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:36.810681 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-29a615f6-0142-405d-a2ea-df3423758c37 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:36.811358 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-29a615f6-0142-405d-a2ea-df3423758c37 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:36.812059 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-29a615f6-0142-405d-a2ea-df3423758c37 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:37.024745 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-29a615f6-0142-405d-a2ea-df3423758c37 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:37.040221 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-29a615f6-0142-405d-a2ea-df3423758c37 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1358 microversion: 2.1 time: 0.243758 Oct 04 03:36:37.042266 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 393/791] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:36 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:37.435551 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-c8d43fd4-8f62-4622-b315-c8346da91191 req-e9ef820a-2054-4e90-b908-edab255c151f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383e855c-f1ac-422d-a48d-520bf0fa0ef6", "tag": "167b0098-8714-4434-9f2b-62fd2dd9cbe9"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:36:37.455067 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c8d43fd4-8f62-4622-b315-c8346da91191 req-e9ef820a-2054-4e90-b908-edab255c151f service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:37.456855 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c8d43fd4-8f62-4622-b315-c8346da91191 req-e9ef820a-2054-4e90-b908-edab255c151f service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:37.457461 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c8d43fd4-8f62-4622-b315-c8346da91191 req-e9ef820a-2054-4e90-b908-edab255c151f service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:37.477638 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-c8d43fd4-8f62-4622-b315-c8346da91191 req-e9ef820a-2054-4e90-b908-edab255c151f service nova] Creating event network-changed:167b0098-8714-4434-9f2b-62fd2dd9cbe9 for instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 on hv-cinder-84914 Oct 04 03:36:37.488181 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-c8d43fd4-8f62-4622-b315-c8346da91191 req-e9ef820a-2054-4e90-b908-edab255c151f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056038 Oct 04 03:36:37.489448 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 399/792] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:36:38.066472 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-cb382953-4922-4897-9a8a-0b1b09378910 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:38.067312 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-cb382953-4922-4897-9a8a-0b1b09378910 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:38.075225 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cb382953-4922-4897-9a8a-0b1b09378910 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:38.075749 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cb382953-4922-4897-9a8a-0b1b09378910 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:38.076200 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cb382953-4922-4897-9a8a-0b1b09378910 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:38.077089 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cb382953-4922-4897-9a8a-0b1b09378910 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:38.077544 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cb382953-4922-4897-9a8a-0b1b09378910 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:38.078283 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cb382953-4922-4897-9a8a-0b1b09378910 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:38.265170 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-cb382953-4922-4897-9a8a-0b1b09378910 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:38.273155 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-cb382953-4922-4897-9a8a-0b1b09378910 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1358 microversion: 2.1 time: 0.211154 Oct 04 03:36:38.273873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 394/793] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:38 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:39.306638 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-10c0dd11-fad1-4b99-a23e-f8d21acfab4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:39.307936 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-10c0dd11-fad1-4b99-a23e-f8d21acfab4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:39.315390 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10c0dd11-fad1-4b99-a23e-f8d21acfab4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:39.315914 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10c0dd11-fad1-4b99-a23e-f8d21acfab4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:39.316353 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10c0dd11-fad1-4b99-a23e-f8d21acfab4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:39.317062 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10c0dd11-fad1-4b99-a23e-f8d21acfab4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:39.317514 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10c0dd11-fad1-4b99-a23e-f8d21acfab4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:39.317939 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10c0dd11-fad1-4b99-a23e-f8d21acfab4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:39.622552 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-10c0dd11-fad1-4b99-a23e-f8d21acfab4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:39.638971 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-10c0dd11-fad1-4b99-a23e-f8d21acfab4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1358 microversion: 2.1 time: 0.340251 Oct 04 03:36:39.640542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 400/794] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:39 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1358 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:40.662870 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-4f469a72-923f-4dd4-ae9b-dc8a21ab70f4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:40.663519 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-4f469a72-923f-4dd4-ae9b-dc8a21ab70f4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:40.671620 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f469a72-923f-4dd4-ae9b-dc8a21ab70f4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:40.674944 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f469a72-923f-4dd4-ae9b-dc8a21ab70f4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:40.675422 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f469a72-923f-4dd4-ae9b-dc8a21ab70f4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:40.676179 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f469a72-923f-4dd4-ae9b-dc8a21ab70f4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:40.677131 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f469a72-923f-4dd4-ae9b-dc8a21ab70f4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:40.689416 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4f469a72-923f-4dd4-ae9b-dc8a21ab70f4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:40.874729 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-4f469a72-923f-4dd4-ae9b-dc8a21ab70f4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:40.883952 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-4f469a72-923f-4dd4-ae9b-dc8a21ab70f4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1358 microversion: 2.1 time: 0.224845 Oct 04 03:36:40.884524 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 395/795] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:40 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:41.909253 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d68b86d8-098f-488e-95e6-a50b32e7c04d tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:41.910477 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d68b86d8-098f-488e-95e6-a50b32e7c04d tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:41.919022 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d68b86d8-098f-488e-95e6-a50b32e7c04d tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:41.920057 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d68b86d8-098f-488e-95e6-a50b32e7c04d tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:41.920649 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d68b86d8-098f-488e-95e6-a50b32e7c04d tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:41.921532 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d68b86d8-098f-488e-95e6-a50b32e7c04d tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:41.922141 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d68b86d8-098f-488e-95e6-a50b32e7c04d tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:41.922719 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d68b86d8-098f-488e-95e6-a50b32e7c04d tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:42.158872 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-d68b86d8-098f-488e-95e6-a50b32e7c04d tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:42.167262 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d68b86d8-098f-488e-95e6-a50b32e7c04d tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1358 microversion: 2.1 time: 0.262034 Oct 04 03:36:42.179701 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 401/796] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:41 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:43.195232 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-ad576cd8-ac3a-411e-860f-263b8d8ff155 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:43.197431 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-ad576cd8-ac3a-411e-860f-263b8d8ff155 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:43.211068 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ad576cd8-ac3a-411e-860f-263b8d8ff155 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:43.211585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ad576cd8-ac3a-411e-860f-263b8d8ff155 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:43.212219 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ad576cd8-ac3a-411e-860f-263b8d8ff155 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:43.213092 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ad576cd8-ac3a-411e-860f-263b8d8ff155 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:43.214418 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ad576cd8-ac3a-411e-860f-263b8d8ff155 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:43.215001 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ad576cd8-ac3a-411e-860f-263b8d8ff155 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:43.430057 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-ad576cd8-ac3a-411e-860f-263b8d8ff155 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:43.441718 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-ad576cd8-ac3a-411e-860f-263b8d8ff155 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1358 microversion: 2.1 time: 0.253401 Oct 04 03:36:43.443182 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 396/797] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:43 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:44.466452 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7c925c30-37f6-482e-a9d0-446304832e3a tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:44.467227 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7c925c30-37f6-482e-a9d0-446304832e3a tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:44.474974 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c925c30-37f6-482e-a9d0-446304832e3a tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:44.475466 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c925c30-37f6-482e-a9d0-446304832e3a tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:44.477228 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c925c30-37f6-482e-a9d0-446304832e3a tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:44.478360 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c925c30-37f6-482e-a9d0-446304832e3a tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:44.479264 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c925c30-37f6-482e-a9d0-446304832e3a tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:44.480025 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c925c30-37f6-482e-a9d0-446304832e3a tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:44.480791 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:44.500096 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:44.639707 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-7c925c30-37f6-482e-a9d0-446304832e3a tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:44.648060 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7c925c30-37f6-482e-a9d0-446304832e3a tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1358 microversion: 2.1 time: 0.185739 Oct 04 03:36:44.648628 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 402/798] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:44 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:45.671601 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-91b9599e-b975-4823-b990-7628df89a826 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:45.672230 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-91b9599e-b975-4823-b990-7628df89a826 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:45.675030 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=6 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:45.681200 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91b9599e-b975-4823-b990-7628df89a826 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:45.681825 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91b9599e-b975-4823-b990-7628df89a826 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:45.682478 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91b9599e-b975-4823-b990-7628df89a826 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:45.683199 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91b9599e-b975-4823-b990-7628df89a826 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:45.683775 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91b9599e-b975-4823-b990-7628df89a826 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:45.684204 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-91b9599e-b975-4823-b990-7628df89a826 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:45.863221 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-91b9599e-b975-4823-b990-7628df89a826 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:45.871321 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-91b9599e-b975-4823-b990-7628df89a826 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1358 microversion: 2.1 time: 0.203699 Oct 04 03:36:45.871912 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 397/799] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:45 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:46.894291 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6eb3751a-dcac-44af-930a-9c6f2a515aec tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:46.894997 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6eb3751a-dcac-44af-930a-9c6f2a515aec tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:46.901876 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6eb3751a-dcac-44af-930a-9c6f2a515aec tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:46.902426 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6eb3751a-dcac-44af-930a-9c6f2a515aec tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:46.902867 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6eb3751a-dcac-44af-930a-9c6f2a515aec tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:46.903765 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6eb3751a-dcac-44af-930a-9c6f2a515aec tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:46.903765 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6eb3751a-dcac-44af-930a-9c6f2a515aec tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:46.905561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6eb3751a-dcac-44af-930a-9c6f2a515aec tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:47.128578 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6eb3751a-dcac-44af-930a-9c6f2a515aec tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:47.140196 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6eb3751a-dcac-44af-930a-9c6f2a515aec tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1358 microversion: 2.1 time: 0.249657 Oct 04 03:36:47.141848 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 403/800] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:46 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:48.178671 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-38038423-627a-437d-b1ce-673d1cfd5014 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:48.179450 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-38038423-627a-437d-b1ce-673d1cfd5014 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:48.186973 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-38038423-627a-437d-b1ce-673d1cfd5014 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:48.187678 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-38038423-627a-437d-b1ce-673d1cfd5014 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:48.188203 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-38038423-627a-437d-b1ce-673d1cfd5014 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:48.189001 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-38038423-627a-437d-b1ce-673d1cfd5014 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:48.189556 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-38038423-627a-437d-b1ce-673d1cfd5014 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:48.190081 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-38038423-627a-437d-b1ce-673d1cfd5014 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:48.333362 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-38038423-627a-437d-b1ce-673d1cfd5014 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:48.341733 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-38038423-627a-437d-b1ce-673d1cfd5014 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1358 microversion: 2.1 time: 0.167732 Oct 04 03:36:48.342312 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 398/801] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:48 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:48.895117 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-173433159", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452", "networks": [{"uuid": "8b0e57e6-e2fb-43c9-9350-35907f357e5b"}]}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:36:49.117824 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] validate_networks() for [('8b0e57e6-e2fb-43c9-9350-35907f357e5b', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:36:49.190404 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-e0723adb-7042-4b94-92d9-84d5b4c32d52 req-325a04c3-0b26-4dd5-8718-c02b1393801c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383e855c-f1ac-422d-a48d-520bf0fa0ef6", "name": "network-vif-plugged", "status": "completed", "tag": "167b0098-8714-4434-9f2b-62fd2dd9cbe9"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:36:49.203438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-e0723adb-7042-4b94-92d9-84d5b4c32d52 req-325a04c3-0b26-4dd5-8718-c02b1393801c service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:49.204235 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-e0723adb-7042-4b94-92d9-84d5b4c32d52 req-325a04c3-0b26-4dd5-8718-c02b1393801c service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:49.205023 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-e0723adb-7042-4b94-92d9-84d5b4c32d52 req-325a04c3-0b26-4dd5-8718-c02b1393801c service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:49.217974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-e0723adb-7042-4b94-92d9-84d5b4c32d52 req-325a04c3-0b26-4dd5-8718-c02b1393801c service nova] Creating event network-vif-plugged:167b0098-8714-4434-9f2b-62fd2dd9cbe9 for instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 on hv-cinder-84914 Oct 04 03:36:49.224687 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-e0723adb-7042-4b94-92d9-84d5b4c32d52 req-325a04c3-0b26-4dd5-8718-c02b1393801c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037947 Oct 04 03:36:49.225315 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 399/802] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:36:49.366354 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-2abd27c7-847d-4efd-90fc-4240bc1b6d4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:49.367166 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-2abd27c7-847d-4efd-90fc-4240bc1b6d4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:49.373644 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2abd27c7-847d-4efd-90fc-4240bc1b6d4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:49.374222 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2abd27c7-847d-4efd-90fc-4240bc1b6d4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:49.374718 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2abd27c7-847d-4efd-90fc-4240bc1b6d4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:49.375527 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2abd27c7-847d-4efd-90fc-4240bc1b6d4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:49.376042 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2abd27c7-847d-4efd-90fc-4240bc1b6d4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:49.376602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-2abd27c7-847d-4efd-90fc-4240bc1b6d4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:49.622042 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-2abd27c7-847d-4efd-90fc-4240bc1b6d4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:49.625086 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:36:49.625514 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:36:49.625983 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:36:49.626390 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:36:49.626806 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:36:49.630644 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-2abd27c7-847d-4efd-90fc-4240bc1b6d4b tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1358 microversion: 2.1 time: 0.268454 Oct 04 03:36:49.631401 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 400/803] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:49 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:36:49.636226 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:49.636713 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:49.637143 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:49.637912 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:49.638374 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:49.639051 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:49.656650 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Getting quotas for project 4221623fae494002a2377210978fc02c. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:36:49.660603 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Getting quotas for user 85100804dda14dd4a086dff05a081431 and project 4221623fae494002a2377210978fc02c. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:36:49.672040 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:36:49.674310 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:36:49.718860 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4d95b4a9-8940-446c-abbb-d90ca6bc9ee5 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.935127 Oct 04 03:36:49.719499 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 404/804] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:36:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 03:36:49.731103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b6d34342-4f4e-4d30-888b-a6bcc54d78ea tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:49.731817 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b6d34342-4f4e-4d30-888b-a6bcc54d78ea tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:49.784713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b6d34342-4f4e-4d30-888b-a6bcc54d78ea tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85100804dda14dd4a086dff05a081431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221623fae494002a2377210978fc02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:49.792388 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b6d34342-4f4e-4d30-888b-a6bcc54d78ea tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b" status: 200 len: 1213 microversion: 2.1 time: 0.064908 Oct 04 03:36:49.793612 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 401/805] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:49 2022] GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:50.655940 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e3737fb0-c2af-4dfc-9d50-33ff4e431985 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:50.656549 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e3737fb0-c2af-4dfc-9d50-33ff4e431985 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:50.662620 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e3737fb0-c2af-4dfc-9d50-33ff4e431985 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:50.663103 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e3737fb0-c2af-4dfc-9d50-33ff4e431985 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:50.663563 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e3737fb0-c2af-4dfc-9d50-33ff4e431985 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:50.664248 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e3737fb0-c2af-4dfc-9d50-33ff4e431985 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:50.664695 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e3737fb0-c2af-4dfc-9d50-33ff4e431985 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:50.665117 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e3737fb0-c2af-4dfc-9d50-33ff4e431985 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:50.794944 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e3737fb0-c2af-4dfc-9d50-33ff4e431985 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:50.802495 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e3737fb0-c2af-4dfc-9d50-33ff4e431985 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1358 microversion: 2.1 time: 0.152230 Oct 04 03:36:50.803039 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 405/806] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:50 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:50.816723 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-6c106787-5ae0-4c1c-a723-03ee2c6a7a8e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:50.817356 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-6c106787-5ae0-4c1c-a723-03ee2c6a7a8e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:50.825619 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6c106787-5ae0-4c1c-a723-03ee2c6a7a8e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:50.826100 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6c106787-5ae0-4c1c-a723-03ee2c6a7a8e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:50.826531 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6c106787-5ae0-4c1c-a723-03ee2c6a7a8e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:50.827215 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6c106787-5ae0-4c1c-a723-03ee2c6a7a8e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:50.827715 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6c106787-5ae0-4c1c-a723-03ee2c6a7a8e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:50.828135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-6c106787-5ae0-4c1c-a723-03ee2c6a7a8e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:50.893415 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-6c106787-5ae0-4c1c-a723-03ee2c6a7a8e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85100804dda14dd4a086dff05a081431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221623fae494002a2377210978fc02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:50.902342 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-6c106787-5ae0-4c1c-a723-03ee2c6a7a8e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b" status: 200 len: 1265 microversion: 2.1 time: 0.090271 Oct 04 03:36:50.902901 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 402/807] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:50 2022] GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:51.826399 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cd32b8e7-26de-4643-adc6-bae9a3edeb68 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:51.827127 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cd32b8e7-26de-4643-adc6-bae9a3edeb68 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:51.833874 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd32b8e7-26de-4643-adc6-bae9a3edeb68 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:51.834530 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd32b8e7-26de-4643-adc6-bae9a3edeb68 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:51.834956 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd32b8e7-26de-4643-adc6-bae9a3edeb68 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:51.835673 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd32b8e7-26de-4643-adc6-bae9a3edeb68 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:51.836121 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd32b8e7-26de-4643-adc6-bae9a3edeb68 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:51.836538 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd32b8e7-26de-4643-adc6-bae9a3edeb68 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:51.926050 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-dfbf4d3f-226b-4a97-9d2a-30199c8fd411 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:51.926576 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-dfbf4d3f-226b-4a97-9d2a-30199c8fd411 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:51.933422 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dfbf4d3f-226b-4a97-9d2a-30199c8fd411 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:51.934047 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dfbf4d3f-226b-4a97-9d2a-30199c8fd411 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:51.934480 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dfbf4d3f-226b-4a97-9d2a-30199c8fd411 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:51.935166 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dfbf4d3f-226b-4a97-9d2a-30199c8fd411 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:51.935637 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dfbf4d3f-226b-4a97-9d2a-30199c8fd411 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:51.936053 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dfbf4d3f-226b-4a97-9d2a-30199c8fd411 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:52.035417 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-dfbf4d3f-226b-4a97-9d2a-30199c8fd411 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85100804dda14dd4a086dff05a081431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221623fae494002a2377210978fc02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:52.044276 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-dfbf4d3f-226b-4a97-9d2a-30199c8fd411 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b" status: 200 len: 1271 microversion: 2.1 time: 0.122466 Oct 04 03:36:52.044857 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 403/808] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:51 2022] GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:36:52.074571 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-cd32b8e7-26de-4643-adc6-bae9a3edeb68 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:52.082228 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cd32b8e7-26de-4643-adc6-bae9a3edeb68 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1547 microversion: 2.1 time: 0.260009 Oct 04 03:36:52.082871 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 406/809] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:51 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1547 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:52.106125 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-857e4cbc-bc47-4d83-92ef-2ac0102c0f41 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:52.106855 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-857e4cbc-bc47-4d83-92ef-2ac0102c0f41 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:52.112648 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-857e4cbc-bc47-4d83-92ef-2ac0102c0f41 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:52.113146 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-857e4cbc-bc47-4d83-92ef-2ac0102c0f41 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:52.113567 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-857e4cbc-bc47-4d83-92ef-2ac0102c0f41 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:52.114244 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-857e4cbc-bc47-4d83-92ef-2ac0102c0f41 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:52.114688 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-857e4cbc-bc47-4d83-92ef-2ac0102c0f41 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:52.115103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-857e4cbc-bc47-4d83-92ef-2ac0102c0f41 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:52.326120 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-857e4cbc-bc47-4d83-92ef-2ac0102c0f41 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:52.334316 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-857e4cbc-bc47-4d83-92ef-2ac0102c0f41 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1547 microversion: 2.1 time: 0.232444 Oct 04 03:36:52.334896 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 404/810] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:52 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1547 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:52.358490 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d929155a-b8e1-476e-82a5-22c33a55618f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:52.363904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-d929155a-b8e1-476e-82a5-22c33a55618f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:52.364900 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d929155a-b8e1-476e-82a5-22c33a55618f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Searching by: {'deleted': False, 'project_id': 'b3442e6424b9446c90d15225faa9553f'} {{(pid=120594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 03:36:52.373595 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d929155a-b8e1-476e-82a5-22c33a55618f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:52.374627 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d929155a-b8e1-476e-82a5-22c33a55618f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:52.375061 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d929155a-b8e1-476e-82a5-22c33a55618f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:52.375832 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d929155a-b8e1-476e-82a5-22c33a55618f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:52.376279 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d929155a-b8e1-476e-82a5-22c33a55618f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:52.376698 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d929155a-b8e1-476e-82a5-22c33a55618f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:52.465412 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.multi_cell_list [None req-d929155a-b8e1-476e-82a5-22c33a55618f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 03:36:52.562739 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d929155a-b8e1-476e-82a5-22c33a55618f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.208988 Oct 04 03:36:52.563238 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 407/811] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Oct 4 03:36:52 2022] GET /compute/v2.1/servers => generated 342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:36:52.576171 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-962accea-5c0c-46cd-9bcf-fc9485718ec9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:52.576782 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-962accea-5c0c-46cd-9bcf-fc9485718ec9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:52.582603 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-962accea-5c0c-46cd-9bcf-fc9485718ec9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:52.583077 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-962accea-5c0c-46cd-9bcf-fc9485718ec9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:52.583532 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-962accea-5c0c-46cd-9bcf-fc9485718ec9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:52.584224 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-962accea-5c0c-46cd-9bcf-fc9485718ec9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:52.584667 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-962accea-5c0c-46cd-9bcf-fc9485718ec9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:52.585086 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-962accea-5c0c-46cd-9bcf-fc9485718ec9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:52.815408 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-962accea-5c0c-46cd-9bcf-fc9485718ec9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:52.824014 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-962accea-5c0c-46cd-9bcf-fc9485718ec9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1547 microversion: 2.1 time: 0.252749 Oct 04 03:36:52.824592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 405/812] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:52 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1547 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:53.030880 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-25b736ba-40b6-4da3-9af2-991ba27b762a req-191d4324-4d7f-4438-a977-6bbdc653004c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63b757a3-63f5-4beb-80bb-e16e471b5c6b", "tag": "7ce9ddae-68a0-4ab8-998c-5f6776af6025"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:36:53.045894 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-25b736ba-40b6-4da3-9af2-991ba27b762a req-191d4324-4d7f-4438-a977-6bbdc653004c service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:53.047233 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-25b736ba-40b6-4da3-9af2-991ba27b762a req-191d4324-4d7f-4438-a977-6bbdc653004c service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:53.047882 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-25b736ba-40b6-4da3-9af2-991ba27b762a req-191d4324-4d7f-4438-a977-6bbdc653004c service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:53.062341 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-25b736ba-40b6-4da3-9af2-991ba27b762a req-191d4324-4d7f-4438-a977-6bbdc653004c service nova] Creating event network-changed:7ce9ddae-68a0-4ab8-998c-5f6776af6025 for instance 63b757a3-63f5-4beb-80bb-e16e471b5c6b on hv-cinder-84914 Oct 04 03:36:53.070480 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-25b736ba-40b6-4da3-9af2-991ba27b762a req-191d4324-4d7f-4438-a977-6bbdc653004c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043175 Oct 04 03:36:53.070682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-335c8dc8-2fb9-42fc-8ff5-01fd4dbf7313 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:53.071356 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-335c8dc8-2fb9-42fc-8ff5-01fd4dbf7313 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:53.072155 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 408/813] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:36:53.081107 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-335c8dc8-2fb9-42fc-8ff5-01fd4dbf7313 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:53.081968 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-335c8dc8-2fb9-42fc-8ff5-01fd4dbf7313 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:53.082631 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-335c8dc8-2fb9-42fc-8ff5-01fd4dbf7313 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:53.083968 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-335c8dc8-2fb9-42fc-8ff5-01fd4dbf7313 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:53.084993 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-335c8dc8-2fb9-42fc-8ff5-01fd4dbf7313 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:53.085575 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-335c8dc8-2fb9-42fc-8ff5-01fd4dbf7313 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:53.324288 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-335c8dc8-2fb9-42fc-8ff5-01fd4dbf7313 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85100804dda14dd4a086dff05a081431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221623fae494002a2377210978fc02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:53.332399 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-335c8dc8-2fb9-42fc-8ff5-01fd4dbf7313 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b" status: 200 len: 1313 microversion: 2.1 time: 0.267131 Oct 04 03:36:53.333065 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 406/814] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:53 2022] GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:36:54.361519 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-818ea490-ab52-4f1f-b5cf-50757cc0932e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:54.362373 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-818ea490-ab52-4f1f-b5cf-50757cc0932e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:54.368695 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-818ea490-ab52-4f1f-b5cf-50757cc0932e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:54.369532 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-818ea490-ab52-4f1f-b5cf-50757cc0932e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:54.370239 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-818ea490-ab52-4f1f-b5cf-50757cc0932e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:54.371226 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-818ea490-ab52-4f1f-b5cf-50757cc0932e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:54.371801 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-818ea490-ab52-4f1f-b5cf-50757cc0932e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:54.372410 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-818ea490-ab52-4f1f-b5cf-50757cc0932e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:54.425183 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-ba065590-2419-4b63-a2fd-2d4ff85abbad tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a7092d7-ce8e-4422-b800-e71ee61d07a8"}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:36:54.427570 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-ba065590-2419-4b63-a2fd-2d4ff85abbad tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:54.434159 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ba065590-2419-4b63-a2fd-2d4ff85abbad tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:54.434637 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ba065590-2419-4b63-a2fd-2d4ff85abbad tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:54.435059 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ba065590-2419-4b63-a2fd-2d4ff85abbad tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:54.435948 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ba065590-2419-4b63-a2fd-2d4ff85abbad tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:54.436391 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ba065590-2419-4b63-a2fd-2d4ff85abbad tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:54.436807 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-ba065590-2419-4b63-a2fd-2d4ff85abbad tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:54.597044 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-818ea490-ab52-4f1f-b5cf-50757cc0932e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85100804dda14dd4a086dff05a081431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221623fae494002a2377210978fc02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:54.605985 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-818ea490-ab52-4f1f-b5cf-50757cc0932e tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b" status: 200 len: 1313 microversion: 2.1 time: 0.252177 Oct 04 03:36:54.606649 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 409/815] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:54 2022] GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:54.688868 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-ba065590-2419-4b63-a2fd-2d4ff85abbad tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "POST /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267399 Oct 04 03:36:54.689489 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 407/816] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Oct 4 03:36:54 2022] POST /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:36:55.628990 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f17ef799-1fc3-4622-b64c-c74b1ec7dcfa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:55.629940 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f17ef799-1fc3-4622-b64c-c74b1ec7dcfa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:55.645906 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f17ef799-1fc3-4622-b64c-c74b1ec7dcfa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:55.646788 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f17ef799-1fc3-4622-b64c-c74b1ec7dcfa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:55.647463 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f17ef799-1fc3-4622-b64c-c74b1ec7dcfa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:55.648436 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f17ef799-1fc3-4622-b64c-c74b1ec7dcfa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:55.649089 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f17ef799-1fc3-4622-b64c-c74b1ec7dcfa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:55.649709 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f17ef799-1fc3-4622-b64c-c74b1ec7dcfa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:55.783458 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f17ef799-1fc3-4622-b64c-c74b1ec7dcfa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85100804dda14dd4a086dff05a081431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221623fae494002a2377210978fc02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:55.791981 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f17ef799-1fc3-4622-b64c-c74b1ec7dcfa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b" status: 200 len: 1313 microversion: 2.1 time: 0.166782 Oct 04 03:36:55.792361 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 410/817] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:55 2022] GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:55.947988 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-717d9d48-edf5-458b-aafe-4476f9e46ce5 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:55.948680 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-717d9d48-edf5-458b-aafe-4476f9e46ce5 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:55.954669 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-717d9d48-edf5-458b-aafe-4476f9e46ce5 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:55.955145 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-717d9d48-edf5-458b-aafe-4476f9e46ce5 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:55.955729 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-717d9d48-edf5-458b-aafe-4476f9e46ce5 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:55.956413 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-717d9d48-edf5-458b-aafe-4476f9e46ce5 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:55.956860 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-717d9d48-edf5-458b-aafe-4476f9e46ce5 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:55.957278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-717d9d48-edf5-458b-aafe-4476f9e46ce5 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:56.089717 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-717d9d48-edf5-458b-aafe-4476f9e46ce5 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:56.097770 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-717d9d48-edf5-458b-aafe-4476f9e46ce5 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1593 microversion: 2.1 time: 0.154747 Oct 04 03:36:56.098328 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 408/818] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:55 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:56.814270 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9507bb92-2632-4832-93c1-d54bfe4f19af tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:56.814958 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9507bb92-2632-4832-93c1-d54bfe4f19af tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:56.821683 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9507bb92-2632-4832-93c1-d54bfe4f19af tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:56.822163 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9507bb92-2632-4832-93c1-d54bfe4f19af tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:56.822713 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9507bb92-2632-4832-93c1-d54bfe4f19af tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:56.823443 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9507bb92-2632-4832-93c1-d54bfe4f19af tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:56.823921 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9507bb92-2632-4832-93c1-d54bfe4f19af tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:56.824345 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9507bb92-2632-4832-93c1-d54bfe4f19af tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:56.957346 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9507bb92-2632-4832-93c1-d54bfe4f19af tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85100804dda14dd4a086dff05a081431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221623fae494002a2377210978fc02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:56.965434 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9507bb92-2632-4832-93c1-d54bfe4f19af tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b" status: 200 len: 1313 microversion: 2.1 time: 0.155041 Oct 04 03:36:56.966002 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 411/819] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:56 2022] GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:57.228491 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-a47930fa-c368-40d3-a3ce-69e63b4a801d req-b7d8f13c-d998-48ea-8492-7637813c9374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63b757a3-63f5-4beb-80bb-e16e471b5c6b", "name": "network-vif-plugged", "status": "completed", "tag": "7ce9ddae-68a0-4ab8-998c-5f6776af6025"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:36:57.241435 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-a47930fa-c368-40d3-a3ce-69e63b4a801d req-b7d8f13c-d998-48ea-8492-7637813c9374 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:57.242118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-a47930fa-c368-40d3-a3ce-69e63b4a801d req-b7d8f13c-d998-48ea-8492-7637813c9374 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:57.242708 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-a47930fa-c368-40d3-a3ce-69e63b4a801d req-b7d8f13c-d998-48ea-8492-7637813c9374 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:57.255611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-a47930fa-c368-40d3-a3ce-69e63b4a801d req-b7d8f13c-d998-48ea-8492-7637813c9374 service nova] Creating event network-vif-plugged:7ce9ddae-68a0-4ab8-998c-5f6776af6025 for instance 63b757a3-63f5-4beb-80bb-e16e471b5c6b on hv-cinder-84914 Oct 04 03:36:57.261850 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-a47930fa-c368-40d3-a3ce-69e63b4a801d req-b7d8f13c-d998-48ea-8492-7637813c9374 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037094 Oct 04 03:36:57.262630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 409/820] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:36:57.989454 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b0d1a38c-aa0a-432f-b7f6-c8281b9a633d tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:57.990058 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b0d1a38c-aa0a-432f-b7f6-c8281b9a633d tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:57.997029 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b0d1a38c-aa0a-432f-b7f6-c8281b9a633d tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:57.997505 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b0d1a38c-aa0a-432f-b7f6-c8281b9a633d tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:57.997934 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b0d1a38c-aa0a-432f-b7f6-c8281b9a633d tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:57.998625 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b0d1a38c-aa0a-432f-b7f6-c8281b9a633d tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:57.999088 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b0d1a38c-aa0a-432f-b7f6-c8281b9a633d tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:57.999516 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b0d1a38c-aa0a-432f-b7f6-c8281b9a633d tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:58.140958 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b0d1a38c-aa0a-432f-b7f6-c8281b9a633d tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85100804dda14dd4a086dff05a081431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221623fae494002a2377210978fc02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:58.149137 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b0d1a38c-aa0a-432f-b7f6-c8281b9a633d tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b" status: 200 len: 1313 microversion: 2.1 time: 0.163404 Oct 04 03:36:58.150369 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 412/821] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:57 2022] GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:58.204116 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-0e964cbe-b129-413c-8a72-ca56fb4413cf req-295cf00f-1c8f-4548-894d-1bf15537b8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383e855c-f1ac-422d-a48d-520bf0fa0ef6", "tag": "167b0098-8714-4434-9f2b-62fd2dd9cbe9"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:36:58.216198 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-0e964cbe-b129-413c-8a72-ca56fb4413cf req-295cf00f-1c8f-4548-894d-1bf15537b8c1 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:58.216724 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-0e964cbe-b129-413c-8a72-ca56fb4413cf req-295cf00f-1c8f-4548-894d-1bf15537b8c1 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:58.217359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-0e964cbe-b129-413c-8a72-ca56fb4413cf req-295cf00f-1c8f-4548-894d-1bf15537b8c1 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:58.230594 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-0e964cbe-b129-413c-8a72-ca56fb4413cf req-295cf00f-1c8f-4548-894d-1bf15537b8c1 service nova] Creating event network-changed:167b0098-8714-4434-9f2b-62fd2dd9cbe9 for instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 on hv-cinder-84914 Oct 04 03:36:58.236453 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-0e964cbe-b129-413c-8a72-ca56fb4413cf req-295cf00f-1c8f-4548-894d-1bf15537b8c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117503 Oct 04 03:36:58.237058 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 410/822] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:36:59.173185 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-83e17ca8-c400-420c-b0c5-db7a392e07fa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:59.173847 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-83e17ca8-c400-420c-b0c5-db7a392e07fa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:59.180724 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e17ca8-c400-420c-b0c5-db7a392e07fa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:59.181487 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e17ca8-c400-420c-b0c5-db7a392e07fa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:59.182594 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e17ca8-c400-420c-b0c5-db7a392e07fa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:59.183644 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e17ca8-c400-420c-b0c5-db7a392e07fa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:59.184464 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e17ca8-c400-420c-b0c5-db7a392e07fa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:59.185048 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e17ca8-c400-420c-b0c5-db7a392e07fa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:59.271096 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b0b7692c-416b-4b63-a094-62790be3bff6 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1217580241"}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:36:59.271757 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b0b7692c-416b-4b63-a094-62790be3bff6 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:59.278224 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0b7692c-416b-4b63-a094-62790be3bff6 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:59.278963 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0b7692c-416b-4b63-a094-62790be3bff6 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:59.279594 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0b7692c-416b-4b63-a094-62790be3bff6 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:59.280490 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0b7692c-416b-4b63-a094-62790be3bff6 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:59.280940 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0b7692c-416b-4b63-a094-62790be3bff6 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:59.281362 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b0b7692c-416b-4b63-a094-62790be3bff6 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:59.296562 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:59.420496 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-83e17ca8-c400-420c-b0c5-db7a392e07fa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85100804dda14dd4a086dff05a081431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221623fae494002a2377210978fc02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:36:59.429501 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-83e17ca8-c400-420c-b0c5-db7a392e07fa tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b" status: 200 len: 1497 microversion: 2.1 time: 0.260475 Oct 04 03:36:59.430157 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 413/823] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:59 2022] GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b => generated 1497 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:36:59.475816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.network.security_group_api [None req-b0b7692c-416b-4b63-a094-62790be3bff6 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Adding security group 0e537497-1ac9-43c6-bbfb-03829c6c2966 to port 167b0098-8714-4434-9f2b-62fd2dd9cbe9 Oct 04 03:36:59.788616 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:59.811327 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b0b7692c-416b-4b63-a094-62790be3bff6 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "POST /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/action" status: 202 len: 0 microversion: 2.1 time: 0.545043 Oct 04 03:36:59.812603 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 411/824] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Oct 4 03:36:59 2022] POST /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 03:36:59.820342 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-025c91cc-a7df-4271-aac7-e415742551cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:36:59.820954 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-025c91cc-a7df-4271-aac7-e415742551cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:36:59.824324 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:59.830163 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-025c91cc-a7df-4271-aac7-e415742551cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:59.830649 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-025c91cc-a7df-4271-aac7-e415742551cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:59.831083 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-025c91cc-a7df-4271-aac7-e415742551cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:59.831851 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-025c91cc-a7df-4271-aac7-e415742551cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:59.832318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-025c91cc-a7df-4271-aac7-e415742551cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:59.832738 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-025c91cc-a7df-4271-aac7-e415742551cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:59.852053 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-5edfa6e2-34f4-43f8-9b93-635b4ffccef8 req-2380f779-f74a-4b60-88c1-fd28eb4e5be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383e855c-f1ac-422d-a48d-520bf0fa0ef6", "tag": "167b0098-8714-4434-9f2b-62fd2dd9cbe9"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:36:59.869461 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-5edfa6e2-34f4-43f8-9b93-635b4ffccef8 req-2380f779-f74a-4b60-88c1-fd28eb4e5be8 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:36:59.870942 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-5edfa6e2-34f4-43f8-9b93-635b4ffccef8 req-2380f779-f74a-4b60-88c1-fd28eb4e5be8 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:36:59.871616 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-5edfa6e2-34f4-43f8-9b93-635b4ffccef8 req-2380f779-f74a-4b60-88c1-fd28eb4e5be8 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:36:59.884812 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-5edfa6e2-34f4-43f8-9b93-635b4ffccef8 req-2380f779-f74a-4b60-88c1-fd28eb4e5be8 service nova] Creating event network-changed:167b0098-8714-4434-9f2b-62fd2dd9cbe9 for instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 on hv-cinder-84914 Oct 04 03:36:59.890816 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-5edfa6e2-34f4-43f8-9b93-635b4ffccef8 req-2380f779-f74a-4b60-88c1-fd28eb4e5be8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042721 Oct 04 03:36:59.892016 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 412/825] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:37:00.105809 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-025c91cc-a7df-4271-aac7-e415742551cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:00.116588 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-025c91cc-a7df-4271-aac7-e415742551cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1759 microversion: 2.1 time: 0.300070 Oct 04 03:37:00.121905 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 414/826] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:36:59 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1759 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:01.648930 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f4072332-b5b9-4f8c-90b2-568b6a4ead21 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:01.649639 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f4072332-b5b9-4f8c-90b2-568b6a4ead21 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:01.656509 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4072332-b5b9-4f8c-90b2-568b6a4ead21 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:01.656991 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4072332-b5b9-4f8c-90b2-568b6a4ead21 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:01.657427 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4072332-b5b9-4f8c-90b2-568b6a4ead21 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:01.658134 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4072332-b5b9-4f8c-90b2-568b6a4ead21 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:01.658588 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4072332-b5b9-4f8c-90b2-568b6a4ead21 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:01.659009 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f4072332-b5b9-4f8c-90b2-568b6a4ead21 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:01.684027 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f4072332-b5b9-4f8c-90b2-568b6a4ead21 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Going to try to terminate instance {{(pid=120595) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:37:01.757625 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f4072332-b5b9-4f8c-90b2-568b6a4ead21 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "DELETE /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b" status: 204 len: 0 microversion: 2.1 time: 0.113204 Oct 04 03:37:01.758207 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 413/827] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:37:01 2022] DELETE /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:37:01.766512 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-18487e81-ce2f-47b0-ba80-6c78d953bd6f tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:01.767589 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-18487e81-ce2f-47b0-ba80-6c78d953bd6f tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:01.773654 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-18487e81-ce2f-47b0-ba80-6c78d953bd6f tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:01.774132 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-18487e81-ce2f-47b0-ba80-6c78d953bd6f tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:01.774556 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-18487e81-ce2f-47b0-ba80-6c78d953bd6f tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:01.775234 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-18487e81-ce2f-47b0-ba80-6c78d953bd6f tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:01.776243 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-18487e81-ce2f-47b0-ba80-6c78d953bd6f tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:01.776661 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-18487e81-ce2f-47b0-ba80-6c78d953bd6f tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:01.905379 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-18487e81-ce2f-47b0-ba80-6c78d953bd6f tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85100804dda14dd4a086dff05a081431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221623fae494002a2377210978fc02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:01.908754 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:01.913660 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-18487e81-ce2f-47b0-ba80-6c78d953bd6f tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b" status: 200 len: 1503 microversion: 2.1 time: 0.150950 Oct 04 03:37:01.914217 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 415/828] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:01 2022] GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:02.937812 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-93d515a6-449a-4dde-9ce4-0f1f2f215340 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:02.938453 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-93d515a6-449a-4dde-9ce4-0f1f2f215340 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:02.945105 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-93d515a6-449a-4dde-9ce4-0f1f2f215340 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:02.945584 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-93d515a6-449a-4dde-9ce4-0f1f2f215340 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:02.946016 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-93d515a6-449a-4dde-9ce4-0f1f2f215340 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:02.946698 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-93d515a6-449a-4dde-9ce4-0f1f2f215340 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:02.947154 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-93d515a6-449a-4dde-9ce4-0f1f2f215340 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:02.947736 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-93d515a6-449a-4dde-9ce4-0f1f2f215340 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:03.078822 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-93d515a6-449a-4dde-9ce4-0f1f2f215340 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85100804dda14dd4a086dff05a081431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221623fae494002a2377210978fc02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:03.086936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-93d515a6-449a-4dde-9ce4-0f1f2f215340 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b" status: 200 len: 1503 microversion: 2.1 time: 0.153513 Oct 04 03:37:03.087504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 414/829] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:02 2022] GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:03.643421 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-cac1b085-0707-4100-be61-b23b7ec10173 req-24ad0b83-1372-467d-824c-a9c25980f227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63b757a3-63f5-4beb-80bb-e16e471b5c6b", "name": "network-vif-deleted", "tag": "7ce9ddae-68a0-4ab8-998c-5f6776af6025"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:37:03.654746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=4 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:03.658495 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-cac1b085-0707-4100-be61-b23b7ec10173 req-24ad0b83-1372-467d-824c-a9c25980f227 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:03.658966 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-cac1b085-0707-4100-be61-b23b7ec10173 req-24ad0b83-1372-467d-824c-a9c25980f227 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:03.659385 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-cac1b085-0707-4100-be61-b23b7ec10173 req-24ad0b83-1372-467d-824c-a9c25980f227 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:03.674203 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-cac1b085-0707-4100-be61-b23b7ec10173 req-24ad0b83-1372-467d-824c-a9c25980f227 service nova] Creating event network-vif-deleted:7ce9ddae-68a0-4ab8-998c-5f6776af6025 for instance 63b757a3-63f5-4beb-80bb-e16e471b5c6b on hv-cinder-84914 Oct 04 03:37:03.679926 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-cac1b085-0707-4100-be61-b23b7ec10173 req-24ad0b83-1372-467d-824c-a9c25980f227 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040012 Oct 04 03:37:03.680702 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 416/830] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:37:04.110426 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c1d6ffc7-2cbe-4204-84cf-ff06f3c8ea87 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:04.111019 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c1d6ffc7-2cbe-4204-84cf-ff06f3c8ea87 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:04.113387 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:04.118809 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1d6ffc7-2cbe-4204-84cf-ff06f3c8ea87 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:04.119395 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1d6ffc7-2cbe-4204-84cf-ff06f3c8ea87 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:04.119851 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1d6ffc7-2cbe-4204-84cf-ff06f3c8ea87 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:04.120731 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1d6ffc7-2cbe-4204-84cf-ff06f3c8ea87 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:04.121176 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1d6ffc7-2cbe-4204-84cf-ff06f3c8ea87 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:04.121585 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1d6ffc7-2cbe-4204-84cf-ff06f3c8ea87 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:04.155818 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1d6ffc7-2cbe-4204-84cf-ff06f3c8ea87 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:04.156350 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1d6ffc7-2cbe-4204-84cf-ff06f3c8ea87 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:04.156783 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c1d6ffc7-2cbe-4204-84cf-ff06f3c8ea87 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:04.157217 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-c1d6ffc7-2cbe-4204-84cf-ff06f3c8ea87 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lazy-loading 'fault' on Instance uuid 63b757a3-63f5-4beb-80bb-e16e471b5c6b {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:37:04.198832 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c1d6ffc7-2cbe-4204-84cf-ff06f3c8ea87 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85100804dda14dd4a086dff05a081431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221623fae494002a2377210978fc02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:04.206146 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c1d6ffc7-2cbe-4204-84cf-ff06f3c8ea87 tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b" status: 200 len: 1303 microversion: 2.1 time: 0.099572 Oct 04 03:37:04.206708 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 415/831] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:04 2022] GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:05.232468 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-66620967-3482-4448-ba3d-07cfb440fc0a tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:05.233163 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-66620967-3482-4448-ba3d-07cfb440fc0a tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] [instance: 63b757a3-63f5-4beb-80bb-e16e471b5c6b] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:05.235641 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:05.241234 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66620967-3482-4448-ba3d-07cfb440fc0a tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:05.241717 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66620967-3482-4448-ba3d-07cfb440fc0a tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:05.242149 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66620967-3482-4448-ba3d-07cfb440fc0a tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:05.242829 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66620967-3482-4448-ba3d-07cfb440fc0a tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:05.243270 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66620967-3482-4448-ba3d-07cfb440fc0a tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:05.243718 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66620967-3482-4448-ba3d-07cfb440fc0a tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:05.258806 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-66620967-3482-4448-ba3d-07cfb440fc0a tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] HTTP exception thrown: Instance 63b757a3-63f5-4beb-80bb-e16e471b5c6b could not be found. Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-66620967-3482-4448-ba3d-07cfb440fc0a tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Request method failure captured: Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b HTTP/1.1 Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6pPdyHSpunVS0Mw0zmaVZkWLge1edadwqmK7oTm_QejMsfjUf4Vfv9uZQIYRgvldcVlcNWiI5UnX1c4-X7hUacOgbeo6WmHCyYXDxQl99ORdA0KfJvLkKtuWftzjcjBbG0gwe5yBCVYvxn4KVsvn0Oc7GCvsgFGp1IuKyz2yMNpgj8 Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: 4221623fae494002a2377210978fc02c Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-VolumesActionsTest-858509819 Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:37:05.261169 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:37:05.262991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4221623fae494002a2377210978fc02c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4221623fae494002a2377210978fc02c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4221623fae494002a2377210978fc02c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4221623fae494002a2377210978fc02c"}]}] Oct 04 03:37:05.262991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-VolumesActionsTest-858509819 Oct 04 03:37:05.262991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: 4221623fae494002a2377210978fc02c Oct 04 03:37:05.262991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-VolumesActionsTest-858509819 Oct 04 03:37:05.262991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-VolumesActionsTest-858509819-project Oct 04 03:37:05.262991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:37:05.262991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:37:05.262991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: 85100804dda14dd4a086dff05a081431 Oct 04 03:37:05.262991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-VolumesActionsTest-858509819-project Oct 04 03:37:05.262991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:37:05.262991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance 63b757a3-63f5-4beb-80bb-e16e471b5c6b could not be found. Oct 04 03:37:05.262991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '63b757a3-63f5-4beb-80bb-e16e471b5c6b'} Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63b757a3-63f5-4beb-80bb-e16e471b5c6b could not be found. Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:37:05.263945 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63b757a3-63f5-4beb-80bb-e16e471b5c6b could not be found. Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63b757a3-63f5-4beb-80bb-e16e471b5c6b could not be found. Oct 04 03:37:05.265330 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:37:05.266524 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-66620967-3482-4448-ba3d-07cfb440fc0a tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] Returning 404 to user: Instance 63b757a3-63f5-4beb-80bb-e16e471b5c6b could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:37:05.266524 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-66620967-3482-4448-ba3d-07cfb440fc0a tempest-VolumesActionsTest-858509819 tempest-VolumesActionsTest-858509819-project] 10.222.0.25 "GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b" status: 404 len: 111 microversion: 2.1 time: 0.034539 Oct 04 03:37:05.266524 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 417/832] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:05 2022] GET /compute/v2.1/servers/63b757a3-63f5-4beb-80bb-e16e471b5c6b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:37:25.551573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-4dc4e33c-395f-4273-9f35-f19f9197ffba tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:37:25.553812 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-4dc4e33c-395f-4273-9f35-f19f9197ffba tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:25.556388 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=3 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:25.557594 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:25.563211 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4dc4e33c-395f-4273-9f35-f19f9197ffba tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:25.563715 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4dc4e33c-395f-4273-9f35-f19f9197ffba tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:25.564147 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4dc4e33c-395f-4273-9f35-f19f9197ffba tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:25.564822 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4dc4e33c-395f-4273-9f35-f19f9197ffba tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:25.565288 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4dc4e33c-395f-4273-9f35-f19f9197ffba tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:25.565682 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-4dc4e33c-395f-4273-9f35-f19f9197ffba tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:25.639084 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-4dc4e33c-395f-4273-9f35-f19f9197ffba tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "POST /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/action" status: 202 len: 0 microversion: 2.1 time: 0.091040 Oct 04 03:37:25.639621 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 416/833] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Oct 4 03:37:25 2022] POST /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:37:25.645804 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=4 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:25.646543 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:25.650824 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-02bf4152-100d-4baf-af23-3838603213f9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:25.651477 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-02bf4152-100d-4baf-af23-3838603213f9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:25.658430 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02bf4152-100d-4baf-af23-3838603213f9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:25.658905 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02bf4152-100d-4baf-af23-3838603213f9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:25.659408 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02bf4152-100d-4baf-af23-3838603213f9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:25.660226 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02bf4152-100d-4baf-af23-3838603213f9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:25.660675 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02bf4152-100d-4baf-af23-3838603213f9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:25.661091 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02bf4152-100d-4baf-af23-3838603213f9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:25.893761 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-02bf4152-100d-4baf-af23-3838603213f9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:25.905371 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-02bf4152-100d-4baf-af23-3838603213f9 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1751 microversion: 2.1 time: 0.261012 Oct 04 03:37:25.905941 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 418/834] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:25 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1751 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:26.931320 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a096cbdf-b0e5-40e1-825f-40ef05c84b87 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:26.932586 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a096cbdf-b0e5-40e1-825f-40ef05c84b87 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:26.939341 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a096cbdf-b0e5-40e1-825f-40ef05c84b87 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:26.939865 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a096cbdf-b0e5-40e1-825f-40ef05c84b87 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:26.940304 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a096cbdf-b0e5-40e1-825f-40ef05c84b87 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:26.941008 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a096cbdf-b0e5-40e1-825f-40ef05c84b87 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:26.941632 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a096cbdf-b0e5-40e1-825f-40ef05c84b87 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:26.942094 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a096cbdf-b0e5-40e1-825f-40ef05c84b87 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:27.093590 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-a096cbdf-b0e5-40e1-825f-40ef05c84b87 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:27.101885 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a096cbdf-b0e5-40e1-825f-40ef05c84b87 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1756 microversion: 2.1 time: 0.175256 Oct 04 03:37:27.102462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 417/835] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:26 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:28.126299 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d925db2c-0f9e-452b-a73c-3e5141f806b4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:28.126904 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d925db2c-0f9e-452b-a73c-3e5141f806b4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:28.133660 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d925db2c-0f9e-452b-a73c-3e5141f806b4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:28.134131 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d925db2c-0f9e-452b-a73c-3e5141f806b4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:28.134559 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d925db2c-0f9e-452b-a73c-3e5141f806b4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:28.135946 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d925db2c-0f9e-452b-a73c-3e5141f806b4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:28.136395 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d925db2c-0f9e-452b-a73c-3e5141f806b4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:28.136814 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d925db2c-0f9e-452b-a73c-3e5141f806b4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:28.279106 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-d925db2c-0f9e-452b-a73c-3e5141f806b4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:28.287213 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d925db2c-0f9e-452b-a73c-3e5141f806b4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1756 microversion: 2.1 time: 0.164784 Oct 04 03:37:28.287798 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 419/836] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:28 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:29.310476 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e6508af1-4837-4902-9f12-7a287cdedcd3 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:29.311081 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e6508af1-4837-4902-9f12-7a287cdedcd3 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:29.317151 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e6508af1-4837-4902-9f12-7a287cdedcd3 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:29.317613 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e6508af1-4837-4902-9f12-7a287cdedcd3 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:29.318043 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e6508af1-4837-4902-9f12-7a287cdedcd3 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:29.318730 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e6508af1-4837-4902-9f12-7a287cdedcd3 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:29.319435 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e6508af1-4837-4902-9f12-7a287cdedcd3 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:29.319886 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e6508af1-4837-4902-9f12-7a287cdedcd3 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:29.459620 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e6508af1-4837-4902-9f12-7a287cdedcd3 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:29.468524 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e6508af1-4837-4902-9f12-7a287cdedcd3 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1756 microversion: 2.1 time: 0.162217 Oct 04 03:37:29.469097 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 418/837] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:29 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:30.494298 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c22c9c96-4b7f-46ad-96cc-d77a5e52efc7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:30.495754 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c22c9c96-4b7f-46ad-96cc-d77a5e52efc7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:30.502028 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c22c9c96-4b7f-46ad-96cc-d77a5e52efc7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:30.502499 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c22c9c96-4b7f-46ad-96cc-d77a5e52efc7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:30.502922 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c22c9c96-4b7f-46ad-96cc-d77a5e52efc7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:30.503639 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c22c9c96-4b7f-46ad-96cc-d77a5e52efc7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:30.504084 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c22c9c96-4b7f-46ad-96cc-d77a5e52efc7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:30.504500 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c22c9c96-4b7f-46ad-96cc-d77a5e52efc7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:30.644576 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c22c9c96-4b7f-46ad-96cc-d77a5e52efc7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:30.653118 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c22c9c96-4b7f-46ad-96cc-d77a5e52efc7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1756 microversion: 2.1 time: 0.162641 Oct 04 03:37:30.653693 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 420/838] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:30 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:31.677019 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-578376bf-5a34-47b3-977d-3809be63e577 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:31.677631 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-578376bf-5a34-47b3-977d-3809be63e577 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:31.684852 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-578376bf-5a34-47b3-977d-3809be63e577 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:31.685337 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-578376bf-5a34-47b3-977d-3809be63e577 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:31.685779 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-578376bf-5a34-47b3-977d-3809be63e577 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:31.686474 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-578376bf-5a34-47b3-977d-3809be63e577 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:31.686920 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-578376bf-5a34-47b3-977d-3809be63e577 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:31.687341 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-578376bf-5a34-47b3-977d-3809be63e577 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:31.876060 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-578376bf-5a34-47b3-977d-3809be63e577 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:31.885230 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-578376bf-5a34-47b3-977d-3809be63e577 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1756 microversion: 2.1 time: 0.211951 Oct 04 03:37:31.886071 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 419/839] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:31 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:32.910359 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-de977075-3ef4-4d83-a540-5d9c2874330f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:32.911101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-de977075-3ef4-4d83-a540-5d9c2874330f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:32.918347 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-de977075-3ef4-4d83-a540-5d9c2874330f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:32.918915 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-de977075-3ef4-4d83-a540-5d9c2874330f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:32.919407 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-de977075-3ef4-4d83-a540-5d9c2874330f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:32.920216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-de977075-3ef4-4d83-a540-5d9c2874330f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:32.920765 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-de977075-3ef4-4d83-a540-5d9c2874330f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:32.921251 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-de977075-3ef4-4d83-a540-5d9c2874330f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:33.071919 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-de977075-3ef4-4d83-a540-5d9c2874330f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:33.081161 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-de977075-3ef4-4d83-a540-5d9c2874330f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1756 microversion: 2.1 time: 0.176194 Oct 04 03:37:33.081721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 421/840] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:32 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:34.105399 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-5ee92a6c-fbdd-406f-8d49-102ef6545e9f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:34.106092 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-5ee92a6c-fbdd-406f-8d49-102ef6545e9f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:34.113009 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5ee92a6c-fbdd-406f-8d49-102ef6545e9f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:34.113569 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5ee92a6c-fbdd-406f-8d49-102ef6545e9f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:34.114071 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5ee92a6c-fbdd-406f-8d49-102ef6545e9f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:34.114838 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5ee92a6c-fbdd-406f-8d49-102ef6545e9f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:34.115414 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5ee92a6c-fbdd-406f-8d49-102ef6545e9f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:34.116213 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5ee92a6c-fbdd-406f-8d49-102ef6545e9f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:34.263582 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-5ee92a6c-fbdd-406f-8d49-102ef6545e9f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:34.271701 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-5ee92a6c-fbdd-406f-8d49-102ef6545e9f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1756 microversion: 2.1 time: 0.171186 Oct 04 03:37:34.272267 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 420/841] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:34 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:35.224167 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-91278189", "imageRef": "e2126fee-af11-452e-80f0-60e7495f939b", "flavorRef": "452"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:37:35.280667 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] validate_networks() for None {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:37:35.296960 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d661edd0-0d19-424a-aa60-30a7c1b6bef7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:35.298228 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d661edd0-0d19-424a-aa60-30a7c1b6bef7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:35.305310 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d661edd0-0d19-424a-aa60-30a7c1b6bef7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:35.305891 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d661edd0-0d19-424a-aa60-30a7c1b6bef7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:35.306433 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d661edd0-0d19-424a-aa60-30a7c1b6bef7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:35.307240 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d661edd0-0d19-424a-aa60-30a7c1b6bef7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:35.307778 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d661edd0-0d19-424a-aa60-30a7c1b6bef7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:35.308280 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d661edd0-0d19-424a-aa60-30a7c1b6bef7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:35.619465 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d661edd0-0d19-424a-aa60-30a7c1b6bef7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:35.627549 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d661edd0-0d19-424a-aa60-30a7c1b6bef7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1756 microversion: 2.1 time: 0.334471 Oct 04 03:37:35.628120 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 421/842] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:35 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1756 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:37:35.656127 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:37:35.656551 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:37:35.657149 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:37:35.657561 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:37:35.658020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:37:35.667252 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:35.667782 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:35.668215 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:35.669108 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:35.669108 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:35.669783 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:35.686382 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Getting quotas for project eb41b9a5d0b44280a80b3a75c9ea80e9. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:37:35.690401 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Getting quotas for user 6cec265ee51f488f9d6c6b2bbc7637f6 and project eb41b9a5d0b44280a80b3a75c9ea80e9. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:37:35.702384 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:37:35.704708 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2126fee-af11-452e-80f0-60e7495f939b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:37:35.749772 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-95b4dce8-f36c-4965-b6e6-32c3a76342a6 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529802 Oct 04 03:37:35.750339 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 422/843] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:37:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 03:37:35.762146 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d71e9db8-d6a4-4a87-8c07-6cb35e5a3258 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:35.762836 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d71e9db8-d6a4-4a87-8c07-6cb35e5a3258 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:35.813958 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d71e9db8-d6a4-4a87-8c07-6cb35e5a3258 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec265ee51f488f9d6c6b2bbc7637f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:35.821306 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d71e9db8-d6a4-4a87-8c07-6cb35e5a3258 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f" status: 200 len: 1213 microversion: 2.1 time: 0.063654 Oct 04 03:37:35.821883 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 422/844] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:35 2022] GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:36.652551 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a676e256-9ce8-44f0-b248-b92b8cc98fa7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:36.653157 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a676e256-9ce8-44f0-b248-b92b8cc98fa7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:36.660017 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a676e256-9ce8-44f0-b248-b92b8cc98fa7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:36.660504 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a676e256-9ce8-44f0-b248-b92b8cc98fa7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:36.660938 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a676e256-9ce8-44f0-b248-b92b8cc98fa7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:36.661632 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a676e256-9ce8-44f0-b248-b92b8cc98fa7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:36.662080 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a676e256-9ce8-44f0-b248-b92b8cc98fa7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:36.662528 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a676e256-9ce8-44f0-b248-b92b8cc98fa7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:36.807442 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-a676e256-9ce8-44f0-b248-b92b8cc98fa7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:36.816850 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a676e256-9ce8-44f0-b248-b92b8cc98fa7 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1756 microversion: 2.1 time: 0.168627 Oct 04 03:37:36.827841 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 423/845] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:36 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:36.844961 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-64a4c006-25c3-4669-b439-22b517615d08 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:36.845710 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-64a4c006-25c3-4669-b439-22b517615d08 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:36.852611 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-64a4c006-25c3-4669-b439-22b517615d08 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:36.853408 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-64a4c006-25c3-4669-b439-22b517615d08 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:36.854742 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-64a4c006-25c3-4669-b439-22b517615d08 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:36.856620 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-64a4c006-25c3-4669-b439-22b517615d08 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:36.857189 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-64a4c006-25c3-4669-b439-22b517615d08 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:36.857735 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-64a4c006-25c3-4669-b439-22b517615d08 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:36.930514 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-64a4c006-25c3-4669-b439-22b517615d08 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec265ee51f488f9d6c6b2bbc7637f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:36.939827 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-64a4c006-25c3-4669-b439-22b517615d08 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f" status: 200 len: 1273 microversion: 2.1 time: 0.098964 Oct 04 03:37:36.940995 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 423/846] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:36 2022] GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:37.842773 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-da167614-3554-41bc-8c60-93e381697b96 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:37.843603 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-da167614-3554-41bc-8c60-93e381697b96 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:37.850150 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da167614-3554-41bc-8c60-93e381697b96 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:37.850698 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da167614-3554-41bc-8c60-93e381697b96 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:37.851212 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da167614-3554-41bc-8c60-93e381697b96 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:37.851864 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da167614-3554-41bc-8c60-93e381697b96 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:37.852316 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da167614-3554-41bc-8c60-93e381697b96 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:37.852737 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da167614-3554-41bc-8c60-93e381697b96 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:37.965261 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-5e979618-9969-4c92-bcf7-a7922551ff55 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:37.965877 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-5e979618-9969-4c92-bcf7-a7922551ff55 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:37.972317 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5e979618-9969-4c92-bcf7-a7922551ff55 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:37.972807 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5e979618-9969-4c92-bcf7-a7922551ff55 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:37.973243 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5e979618-9969-4c92-bcf7-a7922551ff55 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:37.973942 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5e979618-9969-4c92-bcf7-a7922551ff55 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:37.974424 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5e979618-9969-4c92-bcf7-a7922551ff55 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:37.974854 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-5e979618-9969-4c92-bcf7-a7922551ff55 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:38.095789 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-da167614-3554-41bc-8c60-93e381697b96 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:38.104567 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-da167614-3554-41bc-8c60-93e381697b96 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1759 microversion: 2.1 time: 0.265545 Oct 04 03:37:38.105229 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 424/847] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:37 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1759 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:38.216449 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-5e979618-9969-4c92-bcf7-a7922551ff55 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec265ee51f488f9d6c6b2bbc7637f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:38.226745 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-5e979618-9969-4c92-bcf7-a7922551ff55 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f" status: 200 len: 1313 microversion: 2.1 time: 0.265772 Oct 04 03:37:38.227647 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 424/848] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:37 2022] GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:37:38.468758 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-eb7c22b2-342f-4001-aced-54424ea53251 req-fc737f07-5440-4eb5-8edb-c33884d69aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a18ee571-dc18-4ddd-aa1c-b4b49817516f", "tag": "ad2e0c57-29e9-4b79-9a55-719708b5f660"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:37:38.477975 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-eb7c22b2-342f-4001-aced-54424ea53251 req-fc737f07-5440-4eb5-8edb-c33884d69aa8 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:38.478449 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-eb7c22b2-342f-4001-aced-54424ea53251 req-fc737f07-5440-4eb5-8edb-c33884d69aa8 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:38.479759 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-eb7c22b2-342f-4001-aced-54424ea53251 req-fc737f07-5440-4eb5-8edb-c33884d69aa8 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:38.490355 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-eb7c22b2-342f-4001-aced-54424ea53251 req-fc737f07-5440-4eb5-8edb-c33884d69aa8 service nova] Creating event network-changed:ad2e0c57-29e9-4b79-9a55-719708b5f660 for instance a18ee571-dc18-4ddd-aa1c-b4b49817516f on hv-cinder-84914 Oct 04 03:37:38.495533 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-eb7c22b2-342f-4001-aced-54424ea53251 req-fc737f07-5440-4eb5-8edb-c33884d69aa8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030714 Oct 04 03:37:38.496134 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 425/849] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:37:39.251542 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-dcd49841-4c53-4b20-a8fb-7199c9576bbb tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:39.252771 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-dcd49841-4c53-4b20-a8fb-7199c9576bbb tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:39.259409 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dcd49841-4c53-4b20-a8fb-7199c9576bbb tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:39.260567 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dcd49841-4c53-4b20-a8fb-7199c9576bbb tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:39.261035 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dcd49841-4c53-4b20-a8fb-7199c9576bbb tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:39.263099 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dcd49841-4c53-4b20-a8fb-7199c9576bbb tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:39.263099 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dcd49841-4c53-4b20-a8fb-7199c9576bbb tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:39.263099 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-dcd49841-4c53-4b20-a8fb-7199c9576bbb tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:39.393764 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-dcd49841-4c53-4b20-a8fb-7199c9576bbb tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec265ee51f488f9d6c6b2bbc7637f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:39.402373 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-dcd49841-4c53-4b20-a8fb-7199c9576bbb tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f" status: 200 len: 1313 microversion: 2.1 time: 0.155071 Oct 04 03:37:39.402948 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 425/850] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:39 2022] GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:40.426458 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4d12b932-0a5e-4a84-87c9-22029f2aa2c8 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:40.427153 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4d12b932-0a5e-4a84-87c9-22029f2aa2c8 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:40.434263 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d12b932-0a5e-4a84-87c9-22029f2aa2c8 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:40.434746 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d12b932-0a5e-4a84-87c9-22029f2aa2c8 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:40.435175 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d12b932-0a5e-4a84-87c9-22029f2aa2c8 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:40.435888 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d12b932-0a5e-4a84-87c9-22029f2aa2c8 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:40.436337 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d12b932-0a5e-4a84-87c9-22029f2aa2c8 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:40.436754 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d12b932-0a5e-4a84-87c9-22029f2aa2c8 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:40.562747 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-4d12b932-0a5e-4a84-87c9-22029f2aa2c8 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec265ee51f488f9d6c6b2bbc7637f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:40.570650 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4d12b932-0a5e-4a84-87c9-22029f2aa2c8 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f" status: 200 len: 1313 microversion: 2.1 time: 0.148938 Oct 04 03:37:40.571206 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 426/851] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:40 2022] GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:41.593733 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0228dfb1-9873-41b1-adef-00c08f93a4ef tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:41.594269 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-0228dfb1-9873-41b1-adef-00c08f93a4ef tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:41.600646 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0228dfb1-9873-41b1-adef-00c08f93a4ef tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:41.601135 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0228dfb1-9873-41b1-adef-00c08f93a4ef tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:41.601573 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0228dfb1-9873-41b1-adef-00c08f93a4ef tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:41.602291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0228dfb1-9873-41b1-adef-00c08f93a4ef tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:41.602740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0228dfb1-9873-41b1-adef-00c08f93a4ef tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:41.603168 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0228dfb1-9873-41b1-adef-00c08f93a4ef tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:41.734913 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0228dfb1-9873-41b1-adef-00c08f93a4ef tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec265ee51f488f9d6c6b2bbc7637f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:41.742851 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0228dfb1-9873-41b1-adef-00c08f93a4ef tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f" status: 200 len: 1313 microversion: 2.1 time: 0.153099 Oct 04 03:37:41.743410 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 426/852] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:41 2022] GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:42.765559 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c01a02a4-0563-4b11-b11b-1aff24a514fe tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:42.766225 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c01a02a4-0563-4b11-b11b-1aff24a514fe tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:42.772683 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c01a02a4-0563-4b11-b11b-1aff24a514fe tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:42.773163 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c01a02a4-0563-4b11-b11b-1aff24a514fe tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:42.773590 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c01a02a4-0563-4b11-b11b-1aff24a514fe tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:42.774268 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c01a02a4-0563-4b11-b11b-1aff24a514fe tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:42.774957 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c01a02a4-0563-4b11-b11b-1aff24a514fe tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:42.775380 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c01a02a4-0563-4b11-b11b-1aff24a514fe tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:42.908748 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c01a02a4-0563-4b11-b11b-1aff24a514fe tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec265ee51f488f9d6c6b2bbc7637f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:42.916223 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c01a02a4-0563-4b11-b11b-1aff24a514fe tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f" status: 200 len: 1313 microversion: 2.1 time: 0.154492 Oct 04 03:37:42.916779 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 427/853] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:42 2022] GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:43.428906 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-28b33103-97cf-4d52-93ff-017e51e3cebf req-8c300c33-93eb-434f-a9e9-a5e28e4ebf7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a18ee571-dc18-4ddd-aa1c-b4b49817516f", "name": "network-vif-plugged", "status": "completed", "tag": "ad2e0c57-29e9-4b79-9a55-719708b5f660"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:37:43.440211 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-28b33103-97cf-4d52-93ff-017e51e3cebf req-8c300c33-93eb-434f-a9e9-a5e28e4ebf7a service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:43.440555 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-28b33103-97cf-4d52-93ff-017e51e3cebf req-8c300c33-93eb-434f-a9e9-a5e28e4ebf7a service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:43.440955 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-28b33103-97cf-4d52-93ff-017e51e3cebf req-8c300c33-93eb-434f-a9e9-a5e28e4ebf7a service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:43.454388 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-28b33103-97cf-4d52-93ff-017e51e3cebf req-8c300c33-93eb-434f-a9e9-a5e28e4ebf7a service nova] Creating event network-vif-plugged:ad2e0c57-29e9-4b79-9a55-719708b5f660 for instance a18ee571-dc18-4ddd-aa1c-b4b49817516f on hv-cinder-84914 Oct 04 03:37:43.459513 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-28b33103-97cf-4d52-93ff-017e51e3cebf req-8c300c33-93eb-434f-a9e9-a5e28e4ebf7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034442 Oct 04 03:37:43.460421 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 427/854] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:37:43.939806 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-30c7f8d9-a414-4efe-8528-1295ed9cbabf tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:43.940333 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-30c7f8d9-a414-4efe-8528-1295ed9cbabf tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:43.946938 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30c7f8d9-a414-4efe-8528-1295ed9cbabf tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:43.947418 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30c7f8d9-a414-4efe-8528-1295ed9cbabf tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:43.947875 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30c7f8d9-a414-4efe-8528-1295ed9cbabf tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:43.949078 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30c7f8d9-a414-4efe-8528-1295ed9cbabf tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:43.949523 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30c7f8d9-a414-4efe-8528-1295ed9cbabf tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:43.949943 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30c7f8d9-a414-4efe-8528-1295ed9cbabf tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:44.075154 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-30c7f8d9-a414-4efe-8528-1295ed9cbabf tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec265ee51f488f9d6c6b2bbc7637f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:44.082759 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-30c7f8d9-a414-4efe-8528-1295ed9cbabf tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f" status: 200 len: 1313 microversion: 2.1 time: 0.146993 Oct 04 03:37:44.083328 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 428/855] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:43 2022] GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:45.107539 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-d54584d8-3939-4893-8ae8-f3b1fd798ad1 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:45.108241 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-d54584d8-3939-4893-8ae8-f3b1fd798ad1 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:45.114770 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d54584d8-3939-4893-8ae8-f3b1fd798ad1 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:45.115252 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d54584d8-3939-4893-8ae8-f3b1fd798ad1 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:45.115714 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d54584d8-3939-4893-8ae8-f3b1fd798ad1 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:45.116401 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d54584d8-3939-4893-8ae8-f3b1fd798ad1 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:45.116853 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d54584d8-3939-4893-8ae8-f3b1fd798ad1 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:45.117279 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-d54584d8-3939-4893-8ae8-f3b1fd798ad1 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:45.251518 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-d54584d8-3939-4893-8ae8-f3b1fd798ad1 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec265ee51f488f9d6c6b2bbc7637f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:45.259175 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-d54584d8-3939-4893-8ae8-f3b1fd798ad1 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f" status: 200 len: 1463 microversion: 2.1 time: 0.156706 Oct 04 03:37:45.259767 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 428/856] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:45 2022] GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:45.306513 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1eca375e-c540-4664-8d19-3f0348ef973c tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:45.307009 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1eca375e-c540-4664-8d19-3f0348ef973c tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:45.313416 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1eca375e-c540-4664-8d19-3f0348ef973c tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:45.313897 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1eca375e-c540-4664-8d19-3f0348ef973c tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:45.314332 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1eca375e-c540-4664-8d19-3f0348ef973c tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:45.315026 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1eca375e-c540-4664-8d19-3f0348ef973c tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:45.315479 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1eca375e-c540-4664-8d19-3f0348ef973c tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:45.315933 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1eca375e-c540-4664-8d19-3f0348ef973c tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:45.342113 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1eca375e-c540-4664-8d19-3f0348ef973c tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:37:45.416583 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1eca375e-c540-4664-8d19-3f0348ef973c tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f" status: 204 len: 0 microversion: 2.1 time: 0.113620 Oct 04 03:37:45.417599 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 429/857] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:37:45 2022] DELETE /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:37:45.425620 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-acd55f89-4b81-4377-9d47-fffea3a167be tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:45.426216 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-acd55f89-4b81-4377-9d47-fffea3a167be tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:45.432089 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-acd55f89-4b81-4377-9d47-fffea3a167be tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:45.432595 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-acd55f89-4b81-4377-9d47-fffea3a167be tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:45.433083 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-acd55f89-4b81-4377-9d47-fffea3a167be tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:45.433753 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-acd55f89-4b81-4377-9d47-fffea3a167be tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:45.434230 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-acd55f89-4b81-4377-9d47-fffea3a167be tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:45.434639 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-acd55f89-4b81-4377-9d47-fffea3a167be tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:45.719470 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-acd55f89-4b81-4377-9d47-fffea3a167be tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec265ee51f488f9d6c6b2bbc7637f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:45.727409 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-acd55f89-4b81-4377-9d47-fffea3a167be tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f" status: 200 len: 1469 microversion: 2.1 time: 0.305547 Oct 04 03:37:45.727998 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 429/858] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:45 2022] GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f => generated 1469 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:46.750827 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cd241b90-aded-4ef1-ab4a-a942bf204535 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:46.751544 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cd241b90-aded-4ef1-ab4a-a942bf204535 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:46.753443 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:46.754129 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:46.760836 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd241b90-aded-4ef1-ab4a-a942bf204535 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:46.761396 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd241b90-aded-4ef1-ab4a-a942bf204535 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:46.761834 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd241b90-aded-4ef1-ab4a-a942bf204535 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:46.762528 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd241b90-aded-4ef1-ab4a-a942bf204535 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:46.762990 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd241b90-aded-4ef1-ab4a-a942bf204535 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:46.763414 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd241b90-aded-4ef1-ab4a-a942bf204535 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:47.216862 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-cd241b90-aded-4ef1-ab4a-a942bf204535 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec265ee51f488f9d6c6b2bbc7637f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:47.224507 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cd241b90-aded-4ef1-ab4a-a942bf204535 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f" status: 200 len: 1469 microversion: 2.1 time: 0.477923 Oct 04 03:37:47.225069 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 430/859] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:46 2022] GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f => generated 1469 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:47.543218 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-ac2cddec-7e89-46fc-b742-e7bae5b63ec5 req-9edc6c6c-3b7c-4b7a-8692-8d27e6f54383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a18ee571-dc18-4ddd-aa1c-b4b49817516f", "name": "network-vif-deleted", "tag": "ad2e0c57-29e9-4b79-9a55-719708b5f660"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:37:47.550018 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:47.556683 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-ac2cddec-7e89-46fc-b742-e7bae5b63ec5 req-9edc6c6c-3b7c-4b7a-8692-8d27e6f54383 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:47.557173 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-ac2cddec-7e89-46fc-b742-e7bae5b63ec5 req-9edc6c6c-3b7c-4b7a-8692-8d27e6f54383 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:47.557802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-ac2cddec-7e89-46fc-b742-e7bae5b63ec5 req-9edc6c6c-3b7c-4b7a-8692-8d27e6f54383 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:47.570103 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-ac2cddec-7e89-46fc-b742-e7bae5b63ec5 req-9edc6c6c-3b7c-4b7a-8692-8d27e6f54383 service nova] Creating event network-vif-deleted:ad2e0c57-29e9-4b79-9a55-719708b5f660 for instance a18ee571-dc18-4ddd-aa1c-b4b49817516f on hv-cinder-84914 Oct 04 03:37:47.575612 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-ac2cddec-7e89-46fc-b742-e7bae5b63ec5 req-9edc6c6c-3b7c-4b7a-8692-8d27e6f54383 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037940 Oct 04 03:37:47.576262 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 430/860] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:37:48.248419 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0bf8018e-417a-42c2-8741-b7bd7e16b3c7 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:48.249054 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0bf8018e-417a-42c2-8741-b7bd7e16b3c7 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:48.255618 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf8018e-417a-42c2-8741-b7bd7e16b3c7 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:48.256102 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf8018e-417a-42c2-8741-b7bd7e16b3c7 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:48.256532 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf8018e-417a-42c2-8741-b7bd7e16b3c7 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:48.257222 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf8018e-417a-42c2-8741-b7bd7e16b3c7 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:48.257677 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf8018e-417a-42c2-8741-b7bd7e16b3c7 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:48.258098 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf8018e-417a-42c2-8741-b7bd7e16b3c7 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:48.291185 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf8018e-417a-42c2-8741-b7bd7e16b3c7 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:48.291747 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf8018e-417a-42c2-8741-b7bd7e16b3c7 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:48.293175 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bf8018e-417a-42c2-8741-b7bd7e16b3c7 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:48.294012 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-0bf8018e-417a-42c2-8741-b7bd7e16b3c7 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lazy-loading 'fault' on Instance uuid a18ee571-dc18-4ddd-aa1c-b4b49817516f {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:37:48.344639 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-0bf8018e-417a-42c2-8741-b7bd7e16b3c7 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cec265ee51f488f9d6c6b2bbc7637f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:37:48.352352 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0bf8018e-417a-42c2-8741-b7bd7e16b3c7 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f" status: 200 len: 1303 microversion: 2.1 time: 0.107977 Oct 04 03:37:48.359521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 431/861] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:48 2022] GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:37:49.376953 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7cca6eee-e8fe-4161-8195-ef8bf24edc65 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:37:49.377638 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-7cca6eee-e8fe-4161-8195-ef8bf24edc65 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] [instance: a18ee571-dc18-4ddd-aa1c-b4b49817516f] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:37:49.383700 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7cca6eee-e8fe-4161-8195-ef8bf24edc65 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:49.384127 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7cca6eee-e8fe-4161-8195-ef8bf24edc65 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:49.384540 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7cca6eee-e8fe-4161-8195-ef8bf24edc65 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:49.385213 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7cca6eee-e8fe-4161-8195-ef8bf24edc65 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:37:49.386190 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7cca6eee-e8fe-4161-8195-ef8bf24edc65 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:37:49.386646 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7cca6eee-e8fe-4161-8195-ef8bf24edc65 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:37:49.399607 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-7cca6eee-e8fe-4161-8195-ef8bf24edc65 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] HTTP exception thrown: Instance a18ee571-dc18-4ddd-aa1c-b4b49817516f could not be found. Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7cca6eee-e8fe-4161-8195-ef8bf24edc65 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Request method failure captured: Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f HTTP/1.1 Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6p9C89ZfJdrM2HLerdG0MjOmuj7kAcIw0mX54wOWXvGpy6ZMTLcA4Wezae1fZgJ-2QHPWCRTlFoqowTAJCdJuo7ZNz_8PJPSPaa_fV_hkuRwyogZKcW_DAtfYBPvbYFfW_gnTQMw-9LCPLDYEEo1sPsURv_4CJQeplSGyCsiHj3PqM Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: eb41b9a5d0b44280a80b3a75c9ea80e9 Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-VolumesNegativeTest-1348448146 Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:37:49.401880 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:37:49.404118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb41b9a5d0b44280a80b3a75c9ea80e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb41b9a5d0b44280a80b3a75c9ea80e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb41b9a5d0b44280a80b3a75c9ea80e9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb41b9a5d0b44280a80b3a75c9ea80e9"}]}] Oct 04 03:37:49.404118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-VolumesNegativeTest-1348448146 Oct 04 03:37:49.404118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: eb41b9a5d0b44280a80b3a75c9ea80e9 Oct 04 03:37:49.404118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-VolumesNegativeTest-1348448146 Oct 04 03:37:49.404118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-VolumesNegativeTest-1348448146-project Oct 04 03:37:49.404118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:37:49.404118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:37:49.404118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 6cec265ee51f488f9d6c6b2bbc7637f6 Oct 04 03:37:49.404118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-VolumesNegativeTest-1348448146-project Oct 04 03:37:49.404118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:37:49.404118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance a18ee571-dc18-4ddd-aa1c-b4b49817516f could not be found. Oct 04 03:37:49.404118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': 'a18ee571-dc18-4ddd-aa1c-b4b49817516f'} Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a18ee571-dc18-4ddd-aa1c-b4b49817516f could not be found. Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:37:49.405257 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a18ee571-dc18-4ddd-aa1c-b4b49817516f could not be found. Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a18ee571-dc18-4ddd-aa1c-b4b49817516f could not be found. Oct 04 03:37:49.406943 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:37:49.408713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7cca6eee-e8fe-4161-8195-ef8bf24edc65 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] Returning 404 to user: Instance a18ee571-dc18-4ddd-aa1c-b4b49817516f could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:37:49.408713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-7cca6eee-e8fe-4161-8195-ef8bf24edc65 tempest-VolumesNegativeTest-1348448146 tempest-VolumesNegativeTest-1348448146-project] 10.222.0.25 "GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f" status: 404 len: 111 microversion: 2.1 time: 0.030946 Oct 04 03:37:49.408713 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 431/862] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:37:49 2022] GET /compute/v2.1/servers/a18ee571-dc18-4ddd-aa1c-b4b49817516f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:38:10.264691 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1ff59066-67c0-434d-b344-bc557ce643cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1217580241"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:38:10.265869 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1ff59066-67c0-434d-b344-bc557ce643cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:10.278291 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:10.279519 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:10.281394 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ff59066-67c0-434d-b344-bc557ce643cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:10.282298 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ff59066-67c0-434d-b344-bc557ce643cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:10.283095 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ff59066-67c0-434d-b344-bc557ce643cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:10.283898 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ff59066-67c0-434d-b344-bc557ce643cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:10.286536 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ff59066-67c0-434d-b344-bc557ce643cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:10.286992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ff59066-67c0-434d-b344-bc557ce643cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:10.455056 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.network.security_group_api [None req-1ff59066-67c0-434d-b344-bc557ce643cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Removing security group 0e537497-1ac9-43c6-bbfb-03829c6c2966 from port 167b0098-8714-4434-9f2b-62fd2dd9cbe9 Oct 04 03:38:10.794839 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1ff59066-67c0-434d-b344-bc557ce643cf tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "POST /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/action" status: 202 len: 0 microversion: 2.1 time: 0.534988 Oct 04 03:38:10.795455 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 432/863] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Oct 4 03:38:10 2022] POST /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:38:10.802884 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-8e4ce571-8a58-49d4-a6b6-e7dd5ce5dfb8 req-47495133-eb6b-4641-88a2-c73f990e4a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383e855c-f1ac-422d-a48d-520bf0fa0ef6", "tag": "167b0098-8714-4434-9f2b-62fd2dd9cbe9"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:38:10.821579 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=34 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:10.826820 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:10.838013 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-8e4ce571-8a58-49d4-a6b6-e7dd5ce5dfb8 req-47495133-eb6b-4641-88a2-c73f990e4a94 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:10.842710 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-8e4ce571-8a58-49d4-a6b6-e7dd5ce5dfb8 req-47495133-eb6b-4641-88a2-c73f990e4a94 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:10.843356 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-8e4ce571-8a58-49d4-a6b6-e7dd5ce5dfb8 req-47495133-eb6b-4641-88a2-c73f990e4a94 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:10.874847 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-8e4ce571-8a58-49d4-a6b6-e7dd5ce5dfb8 req-47495133-eb6b-4641-88a2-c73f990e4a94 service nova] Creating event network-changed:167b0098-8714-4434-9f2b-62fd2dd9cbe9 for instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 on hv-cinder-84914 Oct 04 03:38:10.892214 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-8e4ce571-8a58-49d4-a6b6-e7dd5ce5dfb8 req-47495133-eb6b-4641-88a2-c73f990e4a94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093535 Oct 04 03:38:10.892833 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 432/864] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:38:12.093956 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a71bbf66-3f3d-4337-b333-a49e0399bced tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:12.094508 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a71bbf66-3f3d-4337-b333-a49e0399bced tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:12.104199 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a71bbf66-3f3d-4337-b333-a49e0399bced tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:12.112364 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-26eec9e4-3423-49c5-9188-82c57bfeab3a req-c8388746-19c1-45ef-8344-a44c9ad5ecdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383e855c-f1ac-422d-a48d-520bf0fa0ef6", "tag": "167b0098-8714-4434-9f2b-62fd2dd9cbe9"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:38:12.117875 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a71bbf66-3f3d-4337-b333-a49e0399bced tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:12.118384 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a71bbf66-3f3d-4337-b333-a49e0399bced tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:12.121492 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a71bbf66-3f3d-4337-b333-a49e0399bced tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:12.123020 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a71bbf66-3f3d-4337-b333-a49e0399bced tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:12.124821 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a71bbf66-3f3d-4337-b333-a49e0399bced tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:12.131603 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-26eec9e4-3423-49c5-9188-82c57bfeab3a req-c8388746-19c1-45ef-8344-a44c9ad5ecdd service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:12.132397 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-26eec9e4-3423-49c5-9188-82c57bfeab3a req-c8388746-19c1-45ef-8344-a44c9ad5ecdd service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:12.133027 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-26eec9e4-3423-49c5-9188-82c57bfeab3a req-c8388746-19c1-45ef-8344-a44c9ad5ecdd service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:12.158531 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-26eec9e4-3423-49c5-9188-82c57bfeab3a req-c8388746-19c1-45ef-8344-a44c9ad5ecdd service nova] Creating event network-changed:167b0098-8714-4434-9f2b-62fd2dd9cbe9 for instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 on hv-cinder-84914 Oct 04 03:38:12.168046 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-26eec9e4-3423-49c5-9188-82c57bfeab3a req-c8388746-19c1-45ef-8344-a44c9ad5ecdd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061314 Oct 04 03:38:12.174839 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 433/865] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:38:12.251029 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-a71bbf66-3f3d-4337-b333-a49e0399bced tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lazy-loading 'services' on Instance uuid 383e855c-f1ac-422d-a48d-520bf0fa0ef6 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:38:12.338619 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a71bbf66-3f3d-4337-b333-a49e0399bced tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "DELETE /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/os-volume_attachments/3a7092d7-ce8e-4422-b800-e71ee61d07a8" status: 202 len: 0 microversion: 2.1 time: 0.250235 Oct 04 03:38:12.340370 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 433/866] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Oct 4 03:38:12 2022] DELETE /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/os-volume_attachments/3a7092d7-ce8e-4422-b800-e71ee61d07a8 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:38:12.350630 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-892c6f33-f76f-4f6c-933b-5221ff07b737 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:12.354582 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-892c6f33-f76f-4f6c-933b-5221ff07b737 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:12.366386 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-892c6f33-f76f-4f6c-933b-5221ff07b737 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:12.367452 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-892c6f33-f76f-4f6c-933b-5221ff07b737 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:12.368823 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-892c6f33-f76f-4f6c-933b-5221ff07b737 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:12.372129 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-892c6f33-f76f-4f6c-933b-5221ff07b737 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:12.373340 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-892c6f33-f76f-4f6c-933b-5221ff07b737 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:12.374183 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-892c6f33-f76f-4f6c-933b-5221ff07b737 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:12.420226 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-892c6f33-f76f-4f6c-933b-5221ff07b737 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075165 Oct 04 03:38:12.421472 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 434/867] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:38:12 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:38:13.436191 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-acb11a55-709d-472b-b463-47e0d21fd386 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:13.439402 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-acb11a55-709d-472b-b463-47e0d21fd386 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:13.450066 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-acb11a55-709d-472b-b463-47e0d21fd386 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:13.450556 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-acb11a55-709d-472b-b463-47e0d21fd386 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:13.451160 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-acb11a55-709d-472b-b463-47e0d21fd386 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:13.452063 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-acb11a55-709d-472b-b463-47e0d21fd386 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:13.454808 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-acb11a55-709d-472b-b463-47e0d21fd386 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:13.455457 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-acb11a55-709d-472b-b463-47e0d21fd386 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:13.502986 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-acb11a55-709d-472b-b463-47e0d21fd386 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072333 Oct 04 03:38:13.504132 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 434/868] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Oct 4 03:38:13 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 03:38:13.515186 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-03f2c661-d839-4586-851b-9ee1ce58de2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:13.515837 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-03f2c661-d839-4586-851b-9ee1ce58de2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:13.521892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-03f2c661-d839-4586-851b-9ee1ce58de2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:13.522380 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-03f2c661-d839-4586-851b-9ee1ce58de2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:13.522821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-03f2c661-d839-4586-851b-9ee1ce58de2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:13.523631 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-03f2c661-d839-4586-851b-9ee1ce58de2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:13.524274 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-03f2c661-d839-4586-851b-9ee1ce58de2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:13.524864 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-03f2c661-d839-4586-851b-9ee1ce58de2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:13.624552 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-03f2c661-d839-4586-851b-9ee1ce58de2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] HTTP exception thrown: Instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 is not attached to volume 3a7092d7-ce8e-4422-b800-e71ee61d07a8 Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-03f2c661-d839-4586-851b-9ee1ce58de2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Request method failure captured: Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: DELETE /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/os-volume_attachments/3a7092d7-ce8e-4422-b800-e71ee61d07a8 HTTP/1.1 Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6ovFM6cvSFLO_B3ie1qgKvIGkYsh91wr1vmLN5Rri3mwrl7NtPiWT2BMl15cWQK3t6GWmv-JOQzqLsUh1SjvFsotp6ZcJzCQehJt66pXfjq3dFrBpG4sDKJGXHkysJvQznJkY7tMf_emdV-2dZoWSKshczFa2FkXkX2KerCzCIpvkM Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: b3442e6424b9446c90d15225faa9553f Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-TestMinimumBasicScenario-642523192 Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:38:13.628740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:38:13.630307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3442e6424b9446c90d15225faa9553f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3442e6424b9446c90d15225faa9553f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b3442e6424b9446c90d15225faa9553f", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b3442e6424b9446c90d15225faa9553f"}]}] Oct 04 03:38:13.630307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-TestMinimumBasicScenario-642523192 Oct 04 03:38:13.630307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: b3442e6424b9446c90d15225faa9553f Oct 04 03:38:13.630307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-TestMinimumBasicScenario-642523192 Oct 04 03:38:13.630307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-TestMinimumBasicScenario-642523192-project Oct 04 03:38:13.630307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:38:13.630307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:38:13.630307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 926111af89d943a597ec28264b1ef026 Oct 04 03:38:13.630307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-TestMinimumBasicScenario-642523192-project Oct 04 03:38:13.630307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:38:13.630307 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 is not attached to volume 3a7092d7-ce8e-4422-b800-e71ee61d07a8 Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'server_id': '383e855c-f1ac-422d-a48d-520bf0fa0ef6', 'id': '3a7092d7-ce8e-4422-b800-e71ee61d07a8'} Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3a7092d7-ce8e-4422-b800-e71ee61d07a8. Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:38:13.631075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 is not attached to volume 3a7092d7-ce8e-4422-b800-e71ee61d07a8 Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 is not attached to volume 3a7092d7-ce8e-4422-b800-e71ee61d07a8 Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:38:13.632440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-03f2c661-d839-4586-851b-9ee1ce58de2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Returning 404 to user: Instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 is not attached to volume 3a7092d7-ce8e-4422-b800-e71ee61d07a8 {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:38:13.633493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-03f2c661-d839-4586-851b-9ee1ce58de2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "DELETE /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/os-volume_attachments/3a7092d7-ce8e-4422-b800-e71ee61d07a8" status: 404 len: 154 microversion: 2.1 time: 0.119376 Oct 04 03:38:13.644383 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 435/869] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Oct 4 03:38:13 2022] DELETE /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6/os-volume_attachments/3a7092d7-ce8e-4422-b800-e71ee61d07a8 => generated 154 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:38:14.837865 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2dd61134-b94e-408b-8cee-94d114db8d4c tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:14.838464 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2dd61134-b94e-408b-8cee-94d114db8d4c tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:14.845683 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2dd61134-b94e-408b-8cee-94d114db8d4c tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:14.846498 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2dd61134-b94e-408b-8cee-94d114db8d4c tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:14.846933 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2dd61134-b94e-408b-8cee-94d114db8d4c tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:14.847653 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2dd61134-b94e-408b-8cee-94d114db8d4c tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:14.848101 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2dd61134-b94e-408b-8cee-94d114db8d4c tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:14.848519 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2dd61134-b94e-408b-8cee-94d114db8d4c tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:14.887694 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2dd61134-b94e-408b-8cee-94d114db8d4c tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:38:15.047757 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2dd61134-b94e-408b-8cee-94d114db8d4c tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "DELETE /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 204 len: 0 microversion: 2.1 time: 0.216277 Oct 04 03:38:15.048876 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 435/870] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:38:14 2022] DELETE /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:38:15.059364 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b1ad9df0-78cd-4fbf-a592-e85f9690086e tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:15.060838 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b1ad9df0-78cd-4fbf-a592-e85f9690086e tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:15.063248 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 03:38:15.064170 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Tue Oct 4 03:38:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 (ip 10.222.0.25) !!! Oct 04 03:38:15.084105 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b1ad9df0-78cd-4fbf-a592-e85f9690086e tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:15.084601 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b1ad9df0-78cd-4fbf-a592-e85f9690086e tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:15.085229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b1ad9df0-78cd-4fbf-a592-e85f9690086e tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:15.086116 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b1ad9df0-78cd-4fbf-a592-e85f9690086e tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:15.086737 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b1ad9df0-78cd-4fbf-a592-e85f9690086e tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:15.087357 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b1ad9df0-78cd-4fbf-a592-e85f9690086e tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:15.264898 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b1ad9df0-78cd-4fbf-a592-e85f9690086e tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:38:15.275295 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b1ad9df0-78cd-4fbf-a592-e85f9690086e tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1553 microversion: 2.1 time: 0.221846 Oct 04 03:38:15.276050 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 436/871] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:38:15 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1553 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:38:16.299884 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9cc67480-de75-471d-9478-0cd9084b0968 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:16.301194 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9cc67480-de75-471d-9478-0cd9084b0968 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:16.307979 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9cc67480-de75-471d-9478-0cd9084b0968 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:16.308568 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9cc67480-de75-471d-9478-0cd9084b0968 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:16.309015 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9cc67480-de75-471d-9478-0cd9084b0968 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:16.309726 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9cc67480-de75-471d-9478-0cd9084b0968 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:16.310180 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9cc67480-de75-471d-9478-0cd9084b0968 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:16.310601 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9cc67480-de75-471d-9478-0cd9084b0968 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:16.489331 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-9cc67480-de75-471d-9478-0cd9084b0968 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:38:16.503464 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9cc67480-de75-471d-9478-0cd9084b0968 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1553 microversion: 2.1 time: 0.207691 Oct 04 03:38:16.504221 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 436/872] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:38:16 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:38:16.661440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-3b76fd9f-e334-44f2-8e44-fd340941137d tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Action: 'create', calling method: .version_select at 0x7f165b3cfe50>, body: {"keypair": {"name": "tempest-TestShelveInstance-2132778266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrcTWRFdNPpTDh5CqY3CUnu3g9+pSIXOCYY+C+fcDEko56M/59RWj0pJfMa+8eCs05GTuDxAOgqs/zTwqUUDoe9r1R8xmbdwYV5Do4RFeIjRxQlwLt2YirfNgKcJZjMRQ=="}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:38:16.684938 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-3b76fd9f-e334-44f2-8e44-fd340941137d tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Getting quotas for project e63ef3dd6cce4b31a35d5ec95b6d22dd. Resources: {'key_pairs'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:38:16.689384 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.quota [None req-3b76fd9f-e334-44f2-8e44-fd340941137d tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Getting quotas for user 8efde9a6b5f044159cca51138d05e7e9 and project e63ef3dd6cce4b31a35d5ec95b6d22dd. Resources: {'key_pairs'} {{(pid=120595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:38:16.713440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-3b76fd9f-e334-44f2-8e44-fd340941137d tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.277550 Oct 04 03:38:16.714055 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 437/873] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Oct 4 03:38:16 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:38:17.261521 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-9fd86753-0200-43e3-a8ee-e8baf69c17d5 req-42298b8b-6f3c-4c5d-854c-fb07da69fbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383e855c-f1ac-422d-a48d-520bf0fa0ef6", "name": "network-vif-deleted", "tag": "167b0098-8714-4434-9f2b-62fd2dd9cbe9"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:38:17.274211 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9fd86753-0200-43e3-a8ee-e8baf69c17d5 req-42298b8b-6f3c-4c5d-854c-fb07da69fbc9 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:17.274781 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9fd86753-0200-43e3-a8ee-e8baf69c17d5 req-42298b8b-6f3c-4c5d-854c-fb07da69fbc9 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:17.275446 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9fd86753-0200-43e3-a8ee-e8baf69c17d5 req-42298b8b-6f3c-4c5d-854c-fb07da69fbc9 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:17.287962 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-9fd86753-0200-43e3-a8ee-e8baf69c17d5 req-42298b8b-6f3c-4c5d-854c-fb07da69fbc9 service nova] Creating event network-vif-deleted:167b0098-8714-4434-9f2b-62fd2dd9cbe9 for instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 on hv-cinder-84914 Oct 04 03:38:17.296421 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-9fd86753-0200-43e3-a8ee-e8baf69c17d5 req-42298b8b-6f3c-4c5d-854c-fb07da69fbc9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038858 Oct 04 03:38:17.297261 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 437/874] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:38:17.529080 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-b7396599-7b28-4984-8b2c-08bf0987fd2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:17.530124 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-b7396599-7b28-4984-8b2c-08bf0987fd2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:17.539548 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b7396599-7b28-4984-8b2c-08bf0987fd2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:17.540188 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b7396599-7b28-4984-8b2c-08bf0987fd2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:17.540767 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b7396599-7b28-4984-8b2c-08bf0987fd2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:17.541773 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b7396599-7b28-4984-8b2c-08bf0987fd2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:17.542349 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b7396599-7b28-4984-8b2c-08bf0987fd2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:17.542870 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b7396599-7b28-4984-8b2c-08bf0987fd2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:17.582670 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b7396599-7b28-4984-8b2c-08bf0987fd2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:17.583773 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b7396599-7b28-4984-8b2c-08bf0987fd2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:17.584499 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-b7396599-7b28-4984-8b2c-08bf0987fd2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:17.585333 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-b7396599-7b28-4984-8b2c-08bf0987fd2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lazy-loading 'fault' on Instance uuid 383e855c-f1ac-422d-a48d-520bf0fa0ef6 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:38:17.677386 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-b7396599-7b28-4984-8b2c-08bf0987fd2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926111af89d943a597ec28264b1ef026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3442e6424b9446c90d15225faa9553f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:38:17.688278 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-b7396599-7b28-4984-8b2c-08bf0987fd2f tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 200 len: 1348 microversion: 2.1 time: 0.164706 Oct 04 03:38:17.703331 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 438/875] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:38:17 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 1348 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:38:18.716803 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-12637355-22b8-468f-b9ea-543327f795d4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:18.717491 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-12637355-22b8-468f-b9ea-543327f795d4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] [instance: 383e855c-f1ac-422d-a48d-520bf0fa0ef6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:18.724348 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-12637355-22b8-468f-b9ea-543327f795d4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:18.724837 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-12637355-22b8-468f-b9ea-543327f795d4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:18.725274 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-12637355-22b8-468f-b9ea-543327f795d4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:18.725970 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-12637355-22b8-468f-b9ea-543327f795d4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:18.726425 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-12637355-22b8-468f-b9ea-543327f795d4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:18.726852 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-12637355-22b8-468f-b9ea-543327f795d4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:18.742110 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-12637355-22b8-468f-b9ea-543327f795d4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] HTTP exception thrown: Instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 could not be found. Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-12637355-22b8-468f-b9ea-543327f795d4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Request method failure captured: Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 HTTP/1.1 Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept: application/json Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Accept-Encoding: identity Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Connection: close Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Length: 0 Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Content-Type: application/json Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Host: 10.222.0.25 Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: Openstack-System-Scope: None Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjO6ovFM6cvSFLO_B3ie1qgKvIGkYsh91wr1vmLN5Rri3mwrl7NtPiWT2BMl15cWQK3t6GWmv-JOQzqLsUh1SjvFsotp6ZcJzCQehJt66pXfjq3dFrBpG4sDKJGXHkysJvQznJkY7tMf_emdV-2dZoWSKshczFa2FkXkX2KerCzCIpvkM Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Id: None Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Domain-Name: None Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Identity-Status: Confirmed Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Is-Admin-Project: True Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Id: default Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Domain-Name: Default Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Id: b3442e6424b9446c90d15225faa9553f Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Project-Name: tempest-TestMinimumBasicScenario-642523192 Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Role: reader,member Oct 04 03:38:18.743797 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Roles: reader,member Oct 04 03:38:18.745231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3442e6424b9446c90d15225faa9553f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b3442e6424b9446c90d15225faa9553f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b3442e6424b9446c90d15225faa9553f", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b3442e6424b9446c90d15225faa9553f"}]}] Oct 04 03:38:18.745231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant: tempest-TestMinimumBasicScenario-642523192 Oct 04 03:38:18.745231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Id: b3442e6424b9446c90d15225faa9553f Oct 04 03:38:18.745231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-Tenant-Name: tempest-TestMinimumBasicScenario-642523192 Oct 04 03:38:18.745231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User: tempest-TestMinimumBasicScenario-642523192-project Oct 04 03:38:18.745231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Id: default Oct 04 03:38:18.745231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Domain-Name: Default Oct 04 03:38:18.745231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Id: 926111af89d943a597ec28264b1ef026 Oct 04 03:38:18.745231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: X-User-Name: tempest-TestMinimumBasicScenario-642523192-project Oct 04 03:38:18.745231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: method: > Oct 04 03:38:18.745231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: exception: Instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 could not be found. Oct 04 03:38:18.745231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: action_args: {'id': '383e855c-f1ac-422d-a48d-520bf0fa0ef6'} Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 could not be found. Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:38:18.746287 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 could not be found. Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 could not be found. Oct 04 03:38:18.748819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Oct 04 03:38:18.751674 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-12637355-22b8-468f-b9ea-543327f795d4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Returning 404 to user: Instance 383e855c-f1ac-422d-a48d-520bf0fa0ef6 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:38:18.751674 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-12637355-22b8-468f-b9ea-543327f795d4 tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6" status: 404 len: 111 microversion: 2.1 time: 0.033382 Oct 04 03:38:18.751674 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 438/876] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:38:18 2022] GET /compute/v2.1/servers/383e855c-f1ac-422d-a48d-520bf0fa0ef6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:38:18.753936 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-4e8df335-01f5-4b40-b0ab-2d947dbb5edd tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] Calling method '.version_select at 0x7f165b5ea700>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:18.778119 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-4e8df335-01f5-4b40-b0ab-2d947dbb5edd tempest-TestMinimumBasicScenario-642523192 tempest-TestMinimumBasicScenario-642523192-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1241954653" status: 202 len: 0 microversion: 2.1 time: 0.027787 Oct 04 03:38:18.778700 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 439/877] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Oct 4 03:38:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1241954653 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:38:31.149386 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2146257900", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2132778266", "security_groups": [{"name": "tempest-secgroup-smoke-570309226"}], "networks": [{"uuid": "8d9cc291-825f-4d8f-9744-a7e0cc29fc12"}], "block_device_mapping_v2": [{"uuid": "e8e440a4-fbf9-40b1-beae-a90a1a9885ce", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:38:31.160194 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:31.160849 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:31.273201 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] validate_networks() for [('8d9cc291-825f-4d8f-9744-a7e0cc29fc12', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 03:38:31.639933 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 03:38:31.640349 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 03:38:31.640815 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 03:38:31.641216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 03:38:31.641616 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 03:38:31.650440 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:31.650909 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:31.651333 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:31.652529 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:31.653305 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:31.654061 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:31.677405 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Getting quotas for project e63ef3dd6cce4b31a35d5ec95b6d22dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 03:38:31.681349 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.quota [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Getting quotas for user 8efde9a6b5f044159cca51138d05e7e9 and project e63ef3dd6cce4b31a35d5ec95b6d22dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 03:38:31.738402 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 03:38:31.740538 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8e440a4-fbf9-40b1-beae-a90a1a9885ce',volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 03:38:31.873722 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d3eeba7d-c9dd-4d48-a387-6ab3024e77a2 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.728171 Oct 04 03:38:31.874352 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 439/878] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Oct 4 03:38:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 03:38:31.883010 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=4 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:31.884175 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=30 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:31.885002 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:31.889347 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-acb81c08-1497-4a03-b1f9-63f2e350f55e tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:31.889879 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-acb81c08-1497-4a03-b1f9-63f2e350f55e tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:31.951623 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-acb81c08-1497-4a03-b1f9-63f2e350f55e tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:38:31.958340 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-acb81c08-1497-4a03-b1f9-63f2e350f55e tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1089 microversion: 2.1 time: 0.076794 Oct 04 03:38:31.958889 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 440/879] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:38:31 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1089 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:38:32.981866 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ed6e923f-89bf-465b-9331-2e154efa17ad tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:32.982681 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ed6e923f-89bf-465b-9331-2e154efa17ad tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:32.991263 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed6e923f-89bf-465b-9331-2e154efa17ad tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:32.991817 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed6e923f-89bf-465b-9331-2e154efa17ad tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:32.992278 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed6e923f-89bf-465b-9331-2e154efa17ad tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:32.993683 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed6e923f-89bf-465b-9331-2e154efa17ad tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:32.994143 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed6e923f-89bf-465b-9331-2e154efa17ad tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:32.995156 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed6e923f-89bf-465b-9331-2e154efa17ad tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:33.096235 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-ed6e923f-89bf-465b-9331-2e154efa17ad tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:38:33.104274 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ed6e923f-89bf-465b-9331-2e154efa17ad tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1205 microversion: 2.1 time: 0.126912 Oct 04 03:38:33.104866 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 440/880] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:38:32 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1205 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:38:34.127801 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-c2e77cb6-11b2-45a4-86ec-8d3923bb3787 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:34.129012 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-c2e77cb6-11b2-45a4-86ec-8d3923bb3787 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:34.135440 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c2e77cb6-11b2-45a4-86ec-8d3923bb3787 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:34.135978 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c2e77cb6-11b2-45a4-86ec-8d3923bb3787 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:34.136952 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c2e77cb6-11b2-45a4-86ec-8d3923bb3787 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:34.137700 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c2e77cb6-11b2-45a4-86ec-8d3923bb3787 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:34.138163 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c2e77cb6-11b2-45a4-86ec-8d3923bb3787 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:34.138586 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-c2e77cb6-11b2-45a4-86ec-8d3923bb3787 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:34.300633 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-893ec822-3b2e-42de-9fc3-6665b534e563 req-5c5e84e0-c923-4e49-ad67-7dd2548eec8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5974f447-5548-4412-bfa8-acef665100f6", "tag": "5f937921-5d6b-499f-87d4-f8c2aff0643f"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:38:34.320685 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-893ec822-3b2e-42de-9fc3-6665b534e563 req-5c5e84e0-c923-4e49-ad67-7dd2548eec8d service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:34.321356 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-893ec822-3b2e-42de-9fc3-6665b534e563 req-5c5e84e0-c923-4e49-ad67-7dd2548eec8d service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:34.321831 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-893ec822-3b2e-42de-9fc3-6665b534e563 req-5c5e84e0-c923-4e49-ad67-7dd2548eec8d service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:34.333417 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-893ec822-3b2e-42de-9fc3-6665b534e563 req-5c5e84e0-c923-4e49-ad67-7dd2548eec8d service nova] Creating event network-changed:5f937921-5d6b-499f-87d4-f8c2aff0643f for instance 5974f447-5548-4412-bfa8-acef665100f6 on hv-cinder-84914 Oct 04 03:38:34.338429 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-893ec822-3b2e-42de-9fc3-6665b534e563 req-5c5e84e0-c923-4e49-ad67-7dd2548eec8d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049499 Oct 04 03:38:34.339290 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 441/881] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 03:38:34.397977 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-c2e77cb6-11b2-45a4-86ec-8d3923bb3787 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:38:34.406758 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-c2e77cb6-11b2-45a4-86ec-8d3923bb3787 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1260 microversion: 2.1 time: 0.282784 Oct 04 03:38:34.407325 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 441/882] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:38:34 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:38:35.430909 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b64f47c5-7c21-4afd-bcc8-44007092f5e0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:35.431626 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b64f47c5-7c21-4afd-bcc8-44007092f5e0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:35.439173 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b64f47c5-7c21-4afd-bcc8-44007092f5e0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:35.439916 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b64f47c5-7c21-4afd-bcc8-44007092f5e0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:35.440348 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b64f47c5-7c21-4afd-bcc8-44007092f5e0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:35.441034 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b64f47c5-7c21-4afd-bcc8-44007092f5e0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:35.441478 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b64f47c5-7c21-4afd-bcc8-44007092f5e0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:35.441895 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b64f47c5-7c21-4afd-bcc8-44007092f5e0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:35.671432 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b64f47c5-7c21-4afd-bcc8-44007092f5e0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:38:35.679217 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b64f47c5-7c21-4afd-bcc8-44007092f5e0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1260 microversion: 2.1 time: 0.252658 Oct 04 03:38:35.679883 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 442/883] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:38:35 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:38:36.703973 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e4a1eb8f-e69e-49ae-a62f-acad7e5e4025 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:36.704599 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e4a1eb8f-e69e-49ae-a62f-acad7e5e4025 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:36.710931 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4a1eb8f-e69e-49ae-a62f-acad7e5e4025 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:36.711408 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4a1eb8f-e69e-49ae-a62f-acad7e5e4025 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:36.711870 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4a1eb8f-e69e-49ae-a62f-acad7e5e4025 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:36.712549 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4a1eb8f-e69e-49ae-a62f-acad7e5e4025 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:36.713000 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4a1eb8f-e69e-49ae-a62f-acad7e5e4025 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:36.713433 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e4a1eb8f-e69e-49ae-a62f-acad7e5e4025 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:36.841771 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e4a1eb8f-e69e-49ae-a62f-acad7e5e4025 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:38:36.849400 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e4a1eb8f-e69e-49ae-a62f-acad7e5e4025 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1260 microversion: 2.1 time: 0.149854 Oct 04 03:38:36.849980 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 442/884] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:38:36 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:38:37.873192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f4f0f2c4-86f1-4b60-89c7-fd33de9853dc tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:37.873794 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f4f0f2c4-86f1-4b60-89c7-fd33de9853dc tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:37.880079 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4f0f2c4-86f1-4b60-89c7-fd33de9853dc tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:37.880551 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4f0f2c4-86f1-4b60-89c7-fd33de9853dc tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:37.880999 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4f0f2c4-86f1-4b60-89c7-fd33de9853dc tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:37.881677 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4f0f2c4-86f1-4b60-89c7-fd33de9853dc tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:37.882122 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4f0f2c4-86f1-4b60-89c7-fd33de9853dc tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:37.882538 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4f0f2c4-86f1-4b60-89c7-fd33de9853dc tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:38.014552 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f4f0f2c4-86f1-4b60-89c7-fd33de9853dc tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:38:38.022662 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f4f0f2c4-86f1-4b60-89c7-fd33de9853dc tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1260 microversion: 2.1 time: 0.154415 Oct 04 03:38:38.023231 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 443/885] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:38:37 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:38:39.046469 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-3d969ccf-1ba3-47d8-986c-141586307fcf tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:39.047075 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-3d969ccf-1ba3-47d8-986c-141586307fcf tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:39.053483 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3d969ccf-1ba3-47d8-986c-141586307fcf tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:39.053968 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3d969ccf-1ba3-47d8-986c-141586307fcf tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:39.054403 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3d969ccf-1ba3-47d8-986c-141586307fcf tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:39.055102 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3d969ccf-1ba3-47d8-986c-141586307fcf tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:39.055562 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3d969ccf-1ba3-47d8-986c-141586307fcf tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:39.055988 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-3d969ccf-1ba3-47d8-986c-141586307fcf tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:39.189544 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-3d969ccf-1ba3-47d8-986c-141586307fcf tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:38:39.197476 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-3d969ccf-1ba3-47d8-986c-141586307fcf tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1260 microversion: 2.1 time: 0.155182 Oct 04 03:38:39.198031 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 443/886] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:38:39 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:38:39.741321 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-3323f743-7ad6-4f81-9344-5164f775b2a8 req-481f7b9d-4f87-4f8c-9251-5b12e073148b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5974f447-5548-4412-bfa8-acef665100f6", "name": "network-vif-plugged", "status": "completed", "tag": "5f937921-5d6b-499f-87d4-f8c2aff0643f"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:38:39.751128 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-3323f743-7ad6-4f81-9344-5164f775b2a8 req-481f7b9d-4f87-4f8c-9251-5b12e073148b service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:39.751679 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-3323f743-7ad6-4f81-9344-5164f775b2a8 req-481f7b9d-4f87-4f8c-9251-5b12e073148b service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:39.752103 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-3323f743-7ad6-4f81-9344-5164f775b2a8 req-481f7b9d-4f87-4f8c-9251-5b12e073148b service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:39.763234 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-3323f743-7ad6-4f81-9344-5164f775b2a8 req-481f7b9d-4f87-4f8c-9251-5b12e073148b service nova] Creating event network-vif-plugged:5f937921-5d6b-499f-87d4-f8c2aff0643f for instance 5974f447-5548-4412-bfa8-acef665100f6 on hv-cinder-84914 Oct 04 03:38:39.768182 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-3323f743-7ad6-4f81-9344-5164f775b2a8 req-481f7b9d-4f87-4f8c-9251-5b12e073148b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030636 Oct 04 03:38:39.768750 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 444/887] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:38:40.221181 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-f34feb3b-19ea-4745-8982-cec44e9da82c tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:40.221914 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-f34feb3b-19ea-4745-8982-cec44e9da82c tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:40.228664 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f34feb3b-19ea-4745-8982-cec44e9da82c tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:40.229399 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f34feb3b-19ea-4745-8982-cec44e9da82c tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:40.230397 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f34feb3b-19ea-4745-8982-cec44e9da82c tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:40.231238 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f34feb3b-19ea-4745-8982-cec44e9da82c tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:40.231717 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f34feb3b-19ea-4745-8982-cec44e9da82c tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:40.232455 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-f34feb3b-19ea-4745-8982-cec44e9da82c tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:40.366873 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-f34feb3b-19ea-4745-8982-cec44e9da82c tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:38:40.375185 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-f34feb3b-19ea-4745-8982-cec44e9da82c tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1260 microversion: 2.1 time: 0.158005 Oct 04 03:38:40.375786 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 444/888] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:38:40 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:38:41.399216 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6b79408f-7fba-42db-87f7-e48d668538a4 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:41.399933 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6b79408f-7fba-42db-87f7-e48d668538a4 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:41.406663 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b79408f-7fba-42db-87f7-e48d668538a4 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:41.407142 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b79408f-7fba-42db-87f7-e48d668538a4 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:41.407596 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b79408f-7fba-42db-87f7-e48d668538a4 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:41.408271 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b79408f-7fba-42db-87f7-e48d668538a4 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:41.408715 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b79408f-7fba-42db-87f7-e48d668538a4 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:41.409157 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b79408f-7fba-42db-87f7-e48d668538a4 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:41.538705 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-6b79408f-7fba-42db-87f7-e48d668538a4 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:38:41.546503 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6b79408f-7fba-42db-87f7-e48d668538a4 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1444 microversion: 2.1 time: 0.152017 Oct 04 03:38:41.547050 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 445/889] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:38:41 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:38:41.568184 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e00ed164-10d4-4967-b793-68bf868596f3 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:38:41.568786 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e00ed164-10d4-4967-b793-68bf868596f3 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:38:41.576009 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e00ed164-10d4-4967-b793-68bf868596f3 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:41.576485 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e00ed164-10d4-4967-b793-68bf868596f3 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:41.576910 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e00ed164-10d4-4967-b793-68bf868596f3 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:41.577586 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e00ed164-10d4-4967-b793-68bf868596f3 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:41.578031 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e00ed164-10d4-4967-b793-68bf868596f3 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:41.578447 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e00ed164-10d4-4967-b793-68bf868596f3 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:41.721656 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e00ed164-10d4-4967-b793-68bf868596f3 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:38:41.729318 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e00ed164-10d4-4967-b793-68bf868596f3 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1444 microversion: 2.1 time: 0.164903 Oct 04 03:38:41.730229 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 445/890] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:38:41 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:38:43.759810 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-ea287db4-58fd-46f0-99ba-008469d12a87 req-9a887bc8-4e3f-4a19-893a-04fe4fbc643e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5974f447-5548-4412-bfa8-acef665100f6", "tag": "5f937921-5d6b-499f-87d4-f8c2aff0643f"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:38:43.764711 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:43.765533 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:43.772649 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ea287db4-58fd-46f0-99ba-008469d12a87 req-9a887bc8-4e3f-4a19-893a-04fe4fbc643e service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:38:43.773126 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ea287db4-58fd-46f0-99ba-008469d12a87 req-9a887bc8-4e3f-4a19-893a-04fe4fbc643e service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:38:43.773553 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ea287db4-58fd-46f0-99ba-008469d12a87 req-9a887bc8-4e3f-4a19-893a-04fe4fbc643e service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:38:43.784973 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-ea287db4-58fd-46f0-99ba-008469d12a87 req-9a887bc8-4e3f-4a19-893a-04fe4fbc643e service nova] Creating event network-changed:5f937921-5d6b-499f-87d4-f8c2aff0643f for instance 5974f447-5548-4412-bfa8-acef665100f6 on hv-cinder-84914 Oct 04 03:38:43.789997 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-ea287db4-58fd-46f0-99ba-008469d12a87 req-9a887bc8-4e3f-4a19-893a-04fe4fbc643e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033774 Oct 04 03:38:43.790857 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 446/891] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:40:34.273218 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de66840a-4322-42c1-8e44-fe1c9aa386c6] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 03:40:34.273872 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell0:SELECT=2 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:40:34.274810 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=14 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:40:34.275276 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=30 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:40:34.276759 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 03:40:34.277011 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Tue Oct 4 03:40:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6/action (ip 10.222.0.25) !!! Oct 04 03:40:34.278306 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 03:40:34.284736 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-bd57bb09-1d6d-4abe-9569-7e54a7776dec tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:40:34.285255 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-bd57bb09-1d6d-4abe-9569-7e54a7776dec tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:34.296528 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bd57bb09-1d6d-4abe-9569-7e54a7776dec tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:34.297003 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bd57bb09-1d6d-4abe-9569-7e54a7776dec tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:34.297435 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bd57bb09-1d6d-4abe-9569-7e54a7776dec tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:34.298113 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bd57bb09-1d6d-4abe-9569-7e54a7776dec tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:34.298555 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bd57bb09-1d6d-4abe-9569-7e54a7776dec tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:34.298973 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-bd57bb09-1d6d-4abe-9569-7e54a7776dec tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:34.321851 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.objects.instance [None req-bd57bb09-1d6d-4abe-9569-7e54a7776dec tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lazy-loading 'flavor' on Instance uuid 5974f447-5548-4412-bfa8-acef665100f6 {{(pid=120595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:40:34.395114 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-bd57bb09-1d6d-4abe-9569-7e54a7776dec tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "POST /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6/action" status: 202 len: 0 microversion: 2.1 time: 0.123397 Oct 04 03:40:34.395731 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 446/892] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Oct 4 03:40:34 2022] POST /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:40:34.402337 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:40:34.403177 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=32 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:40:34.408140 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f200e131-59a5-4b3a-9ab7-2d252070e2f6 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:34.408839 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f200e131-59a5-4b3a-9ab7-2d252070e2f6 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:34.416634 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f200e131-59a5-4b3a-9ab7-2d252070e2f6 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:34.417162 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f200e131-59a5-4b3a-9ab7-2d252070e2f6 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:34.418096 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f200e131-59a5-4b3a-9ab7-2d252070e2f6 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:34.418819 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f200e131-59a5-4b3a-9ab7-2d252070e2f6 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:34.419318 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f200e131-59a5-4b3a-9ab7-2d252070e2f6 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:34.419783 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f200e131-59a5-4b3a-9ab7-2d252070e2f6 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:34.671008 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-f200e131-59a5-4b3a-9ab7-2d252070e2f6 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:34.678714 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f200e131-59a5-4b3a-9ab7-2d252070e2f6 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1569 microversion: 2.1 time: 0.278486 Oct 04 03:40:34.679274 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 447/893] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:34 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1569 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 03:40:35.703351 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-286743de-1202-4fc5-9e17-cd3aed33fe85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:35.704070 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-286743de-1202-4fc5-9e17-cd3aed33fe85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:35.711118 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-286743de-1202-4fc5-9e17-cd3aed33fe85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:35.711629 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-286743de-1202-4fc5-9e17-cd3aed33fe85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:35.712062 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-286743de-1202-4fc5-9e17-cd3aed33fe85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:35.712741 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-286743de-1202-4fc5-9e17-cd3aed33fe85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:35.713184 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-286743de-1202-4fc5-9e17-cd3aed33fe85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:35.713606 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-286743de-1202-4fc5-9e17-cd3aed33fe85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:35.719036 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO oslo.messaging._drivers.impl_rabbit [-] [de66840a-4322-42c1-8e44-fe1c9aa386c6] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49710. Oct 04 03:40:35.894980 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-286743de-1202-4fc5-9e17-cd3aed33fe85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:35.902619 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-286743de-1202-4fc5-9e17-cd3aed33fe85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1569 microversion: 2.1 time: 0.205085 Oct 04 03:40:35.903174 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 447/894] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:35 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:36.926201 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-48a6ebac-8bff-458b-ac33-3c4c84f74d67 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:36.926721 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-48a6ebac-8bff-458b-ac33-3c4c84f74d67 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:36.933782 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-48a6ebac-8bff-458b-ac33-3c4c84f74d67 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:36.934270 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-48a6ebac-8bff-458b-ac33-3c4c84f74d67 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:36.934695 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-48a6ebac-8bff-458b-ac33-3c4c84f74d67 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:36.935379 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-48a6ebac-8bff-458b-ac33-3c4c84f74d67 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:36.935864 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-48a6ebac-8bff-458b-ac33-3c4c84f74d67 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:36.936289 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-48a6ebac-8bff-458b-ac33-3c4c84f74d67 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:37.071785 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-48a6ebac-8bff-458b-ac33-3c4c84f74d67 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:37.080117 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-48a6ebac-8bff-458b-ac33-3c4c84f74d67 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1569 microversion: 2.1 time: 0.157864 Oct 04 03:40:37.080668 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 448/895] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:36 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:38.102803 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-1c15b2ae-ca7f-410c-a909-313e58cd9b10 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:38.103403 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-1c15b2ae-ca7f-410c-a909-313e58cd9b10 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:38.109990 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1c15b2ae-ca7f-410c-a909-313e58cd9b10 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:38.110461 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1c15b2ae-ca7f-410c-a909-313e58cd9b10 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:38.110890 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1c15b2ae-ca7f-410c-a909-313e58cd9b10 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:38.111592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1c15b2ae-ca7f-410c-a909-313e58cd9b10 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:38.112037 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1c15b2ae-ca7f-410c-a909-313e58cd9b10 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:38.112452 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-1c15b2ae-ca7f-410c-a909-313e58cd9b10 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:38.246359 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-1c15b2ae-ca7f-410c-a909-313e58cd9b10 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:38.254042 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-1c15b2ae-ca7f-410c-a909-313e58cd9b10 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1569 microversion: 2.1 time: 0.155090 Oct 04 03:40:38.254601 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 448/896] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:38 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:39.278177 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-79bb4d4c-7d93-49c3-af39-b68ea8df83e9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:39.278774 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-79bb4d4c-7d93-49c3-af39-b68ea8df83e9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:39.285113 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-79bb4d4c-7d93-49c3-af39-b68ea8df83e9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:39.285585 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-79bb4d4c-7d93-49c3-af39-b68ea8df83e9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:39.286007 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-79bb4d4c-7d93-49c3-af39-b68ea8df83e9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:39.286680 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-79bb4d4c-7d93-49c3-af39-b68ea8df83e9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:39.287119 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-79bb4d4c-7d93-49c3-af39-b68ea8df83e9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:39.287551 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-79bb4d4c-7d93-49c3-af39-b68ea8df83e9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:39.414370 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-79bb4d4c-7d93-49c3-af39-b68ea8df83e9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:39.422902 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-79bb4d4c-7d93-49c3-af39-b68ea8df83e9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1569 microversion: 2.1 time: 0.148643 Oct 04 03:40:39.423540 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 449/897] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:39 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:40.446404 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-e884a1ec-9cc6-4e27-9340-6cbd61ab5779 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:40.447011 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-e884a1ec-9cc6-4e27-9340-6cbd61ab5779 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:40.453739 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e884a1ec-9cc6-4e27-9340-6cbd61ab5779 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:40.454221 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e884a1ec-9cc6-4e27-9340-6cbd61ab5779 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:40.454662 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e884a1ec-9cc6-4e27-9340-6cbd61ab5779 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:40.455349 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e884a1ec-9cc6-4e27-9340-6cbd61ab5779 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:40.455826 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e884a1ec-9cc6-4e27-9340-6cbd61ab5779 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:40.456249 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-e884a1ec-9cc6-4e27-9340-6cbd61ab5779 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:40.585969 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-e884a1ec-9cc6-4e27-9340-6cbd61ab5779 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:40.593666 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-e884a1ec-9cc6-4e27-9340-6cbd61ab5779 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1569 microversion: 2.1 time: 0.151411 Oct 04 03:40:40.594228 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 449/898] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:40 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:41.617484 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e09fbd96-518e-4eb5-a992-00a219ce4f66 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:41.618080 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e09fbd96-518e-4eb5-a992-00a219ce4f66 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:41.625069 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e09fbd96-518e-4eb5-a992-00a219ce4f66 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:41.625543 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e09fbd96-518e-4eb5-a992-00a219ce4f66 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:41.625968 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e09fbd96-518e-4eb5-a992-00a219ce4f66 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:41.626671 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e09fbd96-518e-4eb5-a992-00a219ce4f66 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:41.627115 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e09fbd96-518e-4eb5-a992-00a219ce4f66 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:41.627547 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e09fbd96-518e-4eb5-a992-00a219ce4f66 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:41.759157 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-e09fbd96-518e-4eb5-a992-00a219ce4f66 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:41.767063 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e09fbd96-518e-4eb5-a992-00a219ce4f66 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1569 microversion: 2.1 time: 0.153430 Oct 04 03:40:41.767649 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 450/899] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:41 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:42.790995 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-9c3d42c4-24f9-4f6d-97d3-3f8e4f23adfe tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:42.791639 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-9c3d42c4-24f9-4f6d-97d3-3f8e4f23adfe tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:42.798499 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c3d42c4-24f9-4f6d-97d3-3f8e4f23adfe tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:42.798972 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c3d42c4-24f9-4f6d-97d3-3f8e4f23adfe tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:42.799400 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c3d42c4-24f9-4f6d-97d3-3f8e4f23adfe tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:42.800104 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c3d42c4-24f9-4f6d-97d3-3f8e4f23adfe tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:42.800552 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c3d42c4-24f9-4f6d-97d3-3f8e4f23adfe tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:42.800974 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-9c3d42c4-24f9-4f6d-97d3-3f8e4f23adfe tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:42.928575 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-9c3d42c4-24f9-4f6d-97d3-3f8e4f23adfe tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:42.936421 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-9c3d42c4-24f9-4f6d-97d3-3f8e4f23adfe tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1569 microversion: 2.1 time: 0.149198 Oct 04 03:40:42.937002 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 450/900] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:42 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:43.960387 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c0ee36b6-b953-4c80-84ff-2a69da76cde9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:43.960992 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c0ee36b6-b953-4c80-84ff-2a69da76cde9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:43.967469 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0ee36b6-b953-4c80-84ff-2a69da76cde9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:43.967980 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0ee36b6-b953-4c80-84ff-2a69da76cde9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:43.968407 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0ee36b6-b953-4c80-84ff-2a69da76cde9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:43.969082 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0ee36b6-b953-4c80-84ff-2a69da76cde9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:43.969527 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0ee36b6-b953-4c80-84ff-2a69da76cde9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:43.969942 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0ee36b6-b953-4c80-84ff-2a69da76cde9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:44.099243 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-c0ee36b6-b953-4c80-84ff-2a69da76cde9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:44.107511 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c0ee36b6-b953-4c80-84ff-2a69da76cde9 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1569 microversion: 2.1 time: 0.150876 Oct 04 03:40:44.108103 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 451/901] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:43 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:45.131602 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-884a2ede-2ed1-4bf6-8747-17e60309eb7a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:45.132251 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-884a2ede-2ed1-4bf6-8747-17e60309eb7a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:45.139970 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-884a2ede-2ed1-4bf6-8747-17e60309eb7a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:45.140461 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-884a2ede-2ed1-4bf6-8747-17e60309eb7a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:45.140896 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-884a2ede-2ed1-4bf6-8747-17e60309eb7a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:45.141589 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-884a2ede-2ed1-4bf6-8747-17e60309eb7a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:45.142044 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-884a2ede-2ed1-4bf6-8747-17e60309eb7a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:45.142465 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-884a2ede-2ed1-4bf6-8747-17e60309eb7a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:45.273020 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-884a2ede-2ed1-4bf6-8747-17e60309eb7a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:45.281186 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-884a2ede-2ed1-4bf6-8747-17e60309eb7a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1569 microversion: 2.1 time: 0.153489 Oct 04 03:40:45.281742 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 451/902] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:45 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:46.304609 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2fbc2ada-6eed-4127-bbd4-e36fbe105629 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:46.305208 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2fbc2ada-6eed-4127-bbd4-e36fbe105629 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:46.312411 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2fbc2ada-6eed-4127-bbd4-e36fbe105629 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:46.312882 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2fbc2ada-6eed-4127-bbd4-e36fbe105629 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:46.313309 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2fbc2ada-6eed-4127-bbd4-e36fbe105629 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:46.313984 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2fbc2ada-6eed-4127-bbd4-e36fbe105629 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:46.314426 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2fbc2ada-6eed-4127-bbd4-e36fbe105629 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:46.314840 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2fbc2ada-6eed-4127-bbd4-e36fbe105629 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:46.450723 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2fbc2ada-6eed-4127-bbd4-e36fbe105629 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:46.459306 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2fbc2ada-6eed-4127-bbd4-e36fbe105629 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1569 microversion: 2.1 time: 0.158651 Oct 04 03:40:46.459900 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 452/903] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:46 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:47.483802 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-941dca0a-f811-4b82-a5a8-eae2332ba642 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:47.484413 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-941dca0a-f811-4b82-a5a8-eae2332ba642 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:47.490803 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-941dca0a-f811-4b82-a5a8-eae2332ba642 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:47.491285 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-941dca0a-f811-4b82-a5a8-eae2332ba642 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:47.491758 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-941dca0a-f811-4b82-a5a8-eae2332ba642 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:47.492444 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-941dca0a-f811-4b82-a5a8-eae2332ba642 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:47.492900 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-941dca0a-f811-4b82-a5a8-eae2332ba642 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:47.493322 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-941dca0a-f811-4b82-a5a8-eae2332ba642 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:47.627626 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-941dca0a-f811-4b82-a5a8-eae2332ba642 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:47.635420 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-941dca0a-f811-4b82-a5a8-eae2332ba642 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1510 microversion: 2.1 time: 0.155655 Oct 04 03:40:47.636789 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 452/904] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:47 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:47.658991 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6c4c4068-5e2f-4fa3-9c8a-7c3c4b267f8b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:40:47.659645 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6c4c4068-5e2f-4fa3-9c8a-7c3c4b267f8b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:47.666037 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6c4c4068-5e2f-4fa3-9c8a-7c3c4b267f8b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:47.666512 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6c4c4068-5e2f-4fa3-9c8a-7c3c4b267f8b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:47.667023 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6c4c4068-5e2f-4fa3-9c8a-7c3c4b267f8b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:47.667813 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6c4c4068-5e2f-4fa3-9c8a-7c3c4b267f8b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:47.668270 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6c4c4068-5e2f-4fa3-9c8a-7c3c4b267f8b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:47.668688 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6c4c4068-5e2f-4fa3-9c8a-7c3c4b267f8b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:47.710365 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6c4c4068-5e2f-4fa3-9c8a-7c3c4b267f8b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120594) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 03:40:47.774310 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6c4c4068-5e2f-4fa3-9c8a-7c3c4b267f8b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "POST /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6/action" status: 202 len: 0 microversion: 2.1 time: 0.119067 Oct 04 03:40:47.774834 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 453/905] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Oct 4 03:40:47 2022] POST /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 03:40:47.783143 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-7aad6530-171f-4141-a845-d8ae84b12450 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:47.783779 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-7aad6530-171f-4141-a845-d8ae84b12450 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:47.789725 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7aad6530-171f-4141-a845-d8ae84b12450 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:47.790210 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7aad6530-171f-4141-a845-d8ae84b12450 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:47.790643 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7aad6530-171f-4141-a845-d8ae84b12450 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:47.791334 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7aad6530-171f-4141-a845-d8ae84b12450 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:47.791821 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7aad6530-171f-4141-a845-d8ae84b12450 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:47.792870 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-7aad6530-171f-4141-a845-d8ae84b12450 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:47.929146 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-7aad6530-171f-4141-a845-d8ae84b12450 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:47.937373 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-7aad6530-171f-4141-a845-d8ae84b12450 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1518 microversion: 2.1 time: 0.158094 Oct 04 03:40:47.937950 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 453/906] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:47 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:48.961892 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8e851843-d895-45bc-a3ba-27f258cb88a0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:48.962508 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8e851843-d895-45bc-a3ba-27f258cb88a0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:48.968690 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e851843-d895-45bc-a3ba-27f258cb88a0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:48.969229 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e851843-d895-45bc-a3ba-27f258cb88a0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:48.969708 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e851843-d895-45bc-a3ba-27f258cb88a0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:48.970391 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e851843-d895-45bc-a3ba-27f258cb88a0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:48.970886 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e851843-d895-45bc-a3ba-27f258cb88a0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:48.971300 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e851843-d895-45bc-a3ba-27f258cb88a0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:49.110321 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-8e851843-d895-45bc-a3ba-27f258cb88a0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:49.118299 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8e851843-d895-45bc-a3ba-27f258cb88a0 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1520 microversion: 2.1 time: 0.160827 Oct 04 03:40:49.118874 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 454/907] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:48 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:50.142740 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-cc5eea41-420c-4d52-ba7c-2b0ca8e815ce tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:50.143404 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-cc5eea41-420c-4d52-ba7c-2b0ca8e815ce tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:50.149986 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cc5eea41-420c-4d52-ba7c-2b0ca8e815ce tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:50.150462 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cc5eea41-420c-4d52-ba7c-2b0ca8e815ce tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:50.150892 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cc5eea41-420c-4d52-ba7c-2b0ca8e815ce tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:50.152293 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cc5eea41-420c-4d52-ba7c-2b0ca8e815ce tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:50.152867 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cc5eea41-420c-4d52-ba7c-2b0ca8e815ce tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:50.153291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-cc5eea41-420c-4d52-ba7c-2b0ca8e815ce tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:50.289785 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-cc5eea41-420c-4d52-ba7c-2b0ca8e815ce tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:50.301397 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-cc5eea41-420c-4d52-ba7c-2b0ca8e815ce tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1576 microversion: 2.1 time: 0.162230 Oct 04 03:40:50.312331 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 454/908] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:50 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:50.359923 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-1d2df36c-3749-41b9-9701-5bd0a9801015 req-fcbf86a2-999c-4f47-bf30-8a473105dc88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5974f447-5548-4412-bfa8-acef665100f6", "name": "network-vif-unplugged", "status": "completed", "tag": "5f937921-5d6b-499f-87d4-f8c2aff0643f"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:40:50.369848 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-1d2df36c-3749-41b9-9701-5bd0a9801015 req-fcbf86a2-999c-4f47-bf30-8a473105dc88 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:50.370937 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-1d2df36c-3749-41b9-9701-5bd0a9801015 req-fcbf86a2-999c-4f47-bf30-8a473105dc88 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:50.371395 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-1d2df36c-3749-41b9-9701-5bd0a9801015 req-fcbf86a2-999c-4f47-bf30-8a473105dc88 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:50.383334 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-1d2df36c-3749-41b9-9701-5bd0a9801015 req-fcbf86a2-999c-4f47-bf30-8a473105dc88 service nova] Creating event network-vif-unplugged:5f937921-5d6b-499f-87d4-f8c2aff0643f for instance 5974f447-5548-4412-bfa8-acef665100f6 on hv-cinder-84914 Oct 04 03:40:50.389174 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-1d2df36c-3749-41b9-9701-5bd0a9801015 req-fcbf86a2-999c-4f47-bf30-8a473105dc88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114721 Oct 04 03:40:50.389774 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 455/909] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:40:51.326806 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-0c6acd4f-c0ed-4b20-9c41-9d35d6b1bd1a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:51.327438 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-0c6acd4f-c0ed-4b20-9c41-9d35d6b1bd1a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:51.333750 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0c6acd4f-c0ed-4b20-9c41-9d35d6b1bd1a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:51.334226 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0c6acd4f-c0ed-4b20-9c41-9d35d6b1bd1a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:51.334651 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0c6acd4f-c0ed-4b20-9c41-9d35d6b1bd1a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:51.335329 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0c6acd4f-c0ed-4b20-9c41-9d35d6b1bd1a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:51.335815 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0c6acd4f-c0ed-4b20-9c41-9d35d6b1bd1a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:51.336234 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-0c6acd4f-c0ed-4b20-9c41-9d35d6b1bd1a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:51.466651 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-0c6acd4f-c0ed-4b20-9c41-9d35d6b1bd1a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:51.474233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-0c6acd4f-c0ed-4b20-9c41-9d35d6b1bd1a tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1576 microversion: 2.1 time: 0.151975 Oct 04 03:40:51.474791 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 455/910] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:51 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:52.498315 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b4cdace8-2657-4550-8f3c-5e77667d8822 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:40:52.499029 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b4cdace8-2657-4550-8f3c-5e77667d8822 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:40:52.505156 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4cdace8-2657-4550-8f3c-5e77667d8822 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:52.505632 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4cdace8-2657-4550-8f3c-5e77667d8822 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:52.506058 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4cdace8-2657-4550-8f3c-5e77667d8822 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:52.506758 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4cdace8-2657-4550-8f3c-5e77667d8822 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:52.507204 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4cdace8-2657-4550-8f3c-5e77667d8822 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:52.507661 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4cdace8-2657-4550-8f3c-5e77667d8822 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:52.643447 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b4cdace8-2657-4550-8f3c-5e77667d8822 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:40:52.652190 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b4cdace8-2657-4550-8f3c-5e77667d8822 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1563 microversion: 2.1 time: 0.158507 Oct 04 03:40:52.653029 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 456/911] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:40:52 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:40:54.378389 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-513172fb-2977-4410-be13-03a44aa303e7 req-853258b6-e5d2-4eab-860e-f2b69a9207e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5974f447-5548-4412-bfa8-acef665100f6", "name": "network-vif-plugged", "status": "completed", "tag": "5f937921-5d6b-499f-87d4-f8c2aff0643f"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:40:54.390385 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-513172fb-2977-4410-be13-03a44aa303e7 req-853258b6-e5d2-4eab-860e-f2b69a9207e5 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:40:54.390870 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-513172fb-2977-4410-be13-03a44aa303e7 req-853258b6-e5d2-4eab-860e-f2b69a9207e5 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:40:54.391294 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-513172fb-2977-4410-be13-03a44aa303e7 req-853258b6-e5d2-4eab-860e-f2b69a9207e5 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:40:54.402516 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-513172fb-2977-4410-be13-03a44aa303e7 req-853258b6-e5d2-4eab-860e-f2b69a9207e5 service nova] Creating event network-vif-plugged:5f937921-5d6b-499f-87d4-f8c2aff0643f for instance 5974f447-5548-4412-bfa8-acef665100f6 on hv-cinder-84914 Oct 04 03:40:54.407870 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-513172fb-2977-4410-be13-03a44aa303e7 req-853258b6-e5d2-4eab-860e-f2b69a9207e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032844 Oct 04 03:40:54.408466 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 456/912] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:42:05.500631 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:42:05.502207 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:42:05.506872 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-99de4380-add5-4ee4-96af-26c15f478a3b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:42:05.507447 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-99de4380-add5-4ee4-96af-26c15f478a3b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:42:05.508476 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_api:SELECT=22 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:42:05.509535 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG dbcounter [-] [120595] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:42:05.517257 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99de4380-add5-4ee4-96af-26c15f478a3b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:42:05.517600 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99de4380-add5-4ee4-96af-26c15f478a3b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:42:05.518030 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99de4380-add5-4ee4-96af-26c15f478a3b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:42:05.518745 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99de4380-add5-4ee4-96af-26c15f478a3b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:42:05.519192 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99de4380-add5-4ee4-96af-26c15f478a3b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:42:05.519865 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99de4380-add5-4ee4-96af-26c15f478a3b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:42:05.546918 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-99de4380-add5-4ee4-96af-26c15f478a3b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 03:42:05.573494 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-dc960dbb-0805-4932-8e10-d159bf68f2fc req-0c251a1f-5291-4f7a-82fa-0b516023dbc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5974f447-5548-4412-bfa8-acef665100f6", "tag": "5f937921-5d6b-499f-87d4-f8c2aff0643f"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:42:05.583090 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-dc960dbb-0805-4932-8e10-d159bf68f2fc req-0c251a1f-5291-4f7a-82fa-0b516023dbc0 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:42:05.583640 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-dc960dbb-0805-4932-8e10-d159bf68f2fc req-0c251a1f-5291-4f7a-82fa-0b516023dbc0 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:42:05.584069 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-dc960dbb-0805-4932-8e10-d159bf68f2fc req-0c251a1f-5291-4f7a-82fa-0b516023dbc0 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:42:05.596096 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-dc960dbb-0805-4932-8e10-d159bf68f2fc req-0c251a1f-5291-4f7a-82fa-0b516023dbc0 service nova] Creating event network-changed:5f937921-5d6b-499f-87d4-f8c2aff0643f for instance 5974f447-5548-4412-bfa8-acef665100f6 on hv-cinder-84914 Oct 04 03:42:05.601365 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-dc960dbb-0805-4932-8e10-d159bf68f2fc req-0c251a1f-5291-4f7a-82fa-0b516023dbc0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100112 Oct 04 03:42:05.602289 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 457/913] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:42:05.639972 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-99de4380-add5-4ee4-96af-26c15f478a3b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 204 len: 0 microversion: 2.1 time: 0.141017 Oct 04 03:42:05.640917 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 457/914] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Oct 4 03:42:05 2022] DELETE /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 03:42:05.650491 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-97d9e42f-09f5-4d59-b260-fb4508692a89 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:42:05.651144 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-97d9e42f-09f5-4d59-b260-fb4508692a89 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:42:05.658296 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-97d9e42f-09f5-4d59-b260-fb4508692a89 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:42:05.658774 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-97d9e42f-09f5-4d59-b260-fb4508692a89 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:42:05.659223 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-97d9e42f-09f5-4d59-b260-fb4508692a89 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:42:05.659932 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-97d9e42f-09f5-4d59-b260-fb4508692a89 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:42:05.660380 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-97d9e42f-09f5-4d59-b260-fb4508692a89 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:42:05.660799 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-97d9e42f-09f5-4d59-b260-fb4508692a89 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:42:05.796804 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.policy [None req-97d9e42f-09f5-4d59-b260-fb4508692a89 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120595) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:42:05.804910 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-97d9e42f-09f5-4d59-b260-fb4508692a89 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1569 microversion: 2.1 time: 0.158999 Oct 04 03:42:05.805493 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 458/915] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:42:05 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:42:06.829870 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b5ecc748-5632-441c-9c1d-87a54668eb5b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:42:06.830560 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b5ecc748-5632-441c-9c1d-87a54668eb5b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:42:06.837236 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ecc748-5632-441c-9c1d-87a54668eb5b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:42:06.837711 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ecc748-5632-441c-9c1d-87a54668eb5b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:42:06.838137 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ecc748-5632-441c-9c1d-87a54668eb5b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:42:06.838817 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ecc748-5632-441c-9c1d-87a54668eb5b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:42:06.839260 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ecc748-5632-441c-9c1d-87a54668eb5b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:42:06.839704 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ecc748-5632-441c-9c1d-87a54668eb5b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:42:07.028885 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-b5ecc748-5632-441c-9c1d-87a54668eb5b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:42:07.036803 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b5ecc748-5632-441c-9c1d-87a54668eb5b tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1569 microversion: 2.1 time: 0.211676 Oct 04 03:42:07.044100 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 458/916] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:42:06 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:42:07.616237 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [req-903b1cf2-0a44-4c52-84cf-666e61ce4d5b req-46da2b7e-7683-4360-85de-5ade3a82cc89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5974f447-5548-4412-bfa8-acef665100f6", "name": "network-vif-deleted", "tag": "5f937921-5d6b-499f-87d4-f8c2aff0643f"}]} {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 03:42:07.626929 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-903b1cf2-0a44-4c52-84cf-666e61ce4d5b req-46da2b7e-7683-4360-85de-5ade3a82cc89 service nova] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:42:07.627415 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-903b1cf2-0a44-4c52-84cf-666e61ce4d5b req-46da2b7e-7683-4360-85de-5ade3a82cc89 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:42:07.627909 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [req-903b1cf2-0a44-4c52-84cf-666e61ce4d5b req-46da2b7e-7683-4360-85de-5ade3a82cc89 service nova] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:42:07.643233 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.compute.server_external_events [req-903b1cf2-0a44-4c52-84cf-666e61ce4d5b req-46da2b7e-7683-4360-85de-5ade3a82cc89 service nova] Creating event network-vif-deleted:5f937921-5d6b-499f-87d4-f8c2aff0643f for instance 5974f447-5548-4412-bfa8-acef665100f6 on hv-cinder-84914 Oct 04 03:42:07.648197 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [req-903b1cf2-0a44-4c52-84cf-666e61ce4d5b req-46da2b7e-7683-4360-85de-5ade3a82cc89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035692 Oct 04 03:42:07.648888 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 459/917] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Oct 4 03:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 03:42:08.060522 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2bb806bd-cc29-4805-ad06-09a8656b8d85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:42:08.061246 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2bb806bd-cc29-4805-ad06-09a8656b8d85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:42:08.068976 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bb806bd-cc29-4805-ad06-09a8656b8d85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:42:08.069542 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bb806bd-cc29-4805-ad06-09a8656b8d85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:42:08.069983 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bb806bd-cc29-4805-ad06-09a8656b8d85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:42:08.070683 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bb806bd-cc29-4805-ad06-09a8656b8d85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:42:08.071140 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bb806bd-cc29-4805-ad06-09a8656b8d85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:42:08.071595 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bb806bd-cc29-4805-ad06-09a8656b8d85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:42:08.112771 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bb806bd-cc29-4805-ad06-09a8656b8d85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:42:08.113250 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bb806bd-cc29-4805-ad06-09a8656b8d85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:42:08.113684 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bb806bd-cc29-4805-ad06-09a8656b8d85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:42:08.114127 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-2bb806bd-cc29-4805-ad06-09a8656b8d85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lazy-loading 'fault' on Instance uuid 5974f447-5548-4412-bfa8-acef665100f6 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 03:42:08.158539 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.policy [None req-2bb806bd-cc29-4805-ad06-09a8656b8d85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efde9a6b5f044159cca51138d05e7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 03:42:08.165530 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2bb806bd-cc29-4805-ad06-09a8656b8d85 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 200 len: 1179 microversion: 2.1 time: 0.108978 Oct 04 03:42:08.166098 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 459/918] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:42:08 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 1179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 03:42:09.190486 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a601675a-4ce5-4daf-a0ba-42b4a1d4610f tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '>' {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:42:09.191170 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.compute.api [None req-a601675a-4ce5-4daf-a0ba-42b4a1d4610f tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [instance: 5974f447-5548-4412-bfa8-acef665100f6] Fetching instance by UUID {{(pid=120595) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 03:42:09.197544 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a601675a-4ce5-4daf-a0ba-42b4a1d4610f tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:42:09.198021 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a601675a-4ce5-4daf-a0ba-42b4a1d4610f tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:42:09.198450 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a601675a-4ce5-4daf-a0ba-42b4a1d4610f tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:42:09.199124 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a601675a-4ce5-4daf-a0ba-42b4a1d4610f tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Acquiring lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 03:42:09.199592 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a601675a-4ce5-4daf-a0ba-42b4a1d4610f tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 03:42:09.200014 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG oslo_concurrency.lockutils [None req-a601675a-4ce5-4daf-a0ba-42b4a1d4610f tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Lock "c793cbfa-d3d2-4516-ac60-2697c5f19478" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 03:42:09.214881 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.wsgi [None req-a601675a-4ce5-4daf-a0ba-42b4a1d4610f tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] HTTP exception thrown: Instance 5974f447-5548-4412-bfa8-acef665100f6 could not be found. Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a601675a-4ce5-4daf-a0ba-42b4a1d4610f tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Request method failure captured: Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: request: GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 HTTP/1.1 Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept: application/json Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Accept-Encoding: identity Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Connection: close Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Length: 0 Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Content-Type: application/json Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Host: 10.222.0.25 Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: Openstack-System-Scope: None Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: User-Agent: python-urllib3/1.26.12 Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Auth-Token: gAAAAABjO6qhWaooTU4xuEwc-7YxBdE5AzmL1BTGnZqJ7sor47HqEIxIkIRE_j6feWWLaQV8V0HSoe3-t50QhgfdCN1z8ilChXnexkMnoKoMJqw7ZZqmoHe4J6COljnL2YIoBldiPGqK0PY14A9bOQUz32IVX1rsqm8Md8FyG59B5ftpbCa82vY Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Id: None Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Domain-Name: None Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Identity-Status: Confirmed Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Is-Admin-Project: True Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Id: default Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Domain-Name: Default Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Id: e63ef3dd6cce4b31a35d5ec95b6d22dd Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Project-Name: tempest-TestShelveInstance-1263131412 Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Role: reader,member Oct 04 03:42:09.216504 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Roles: reader,member Oct 04 03:42:09.218291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e63ef3dd6cce4b31a35d5ec95b6d22dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e63ef3dd6cce4b31a35d5ec95b6d22dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e63ef3dd6cce4b31a35d5ec95b6d22dd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e63ef3dd6cce4b31a35d5ec95b6d22dd"}]}] Oct 04 03:42:09.218291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant: tempest-TestShelveInstance-1263131412 Oct 04 03:42:09.218291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Id: e63ef3dd6cce4b31a35d5ec95b6d22dd Oct 04 03:42:09.218291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-Tenant-Name: tempest-TestShelveInstance-1263131412 Oct 04 03:42:09.218291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User: tempest-TestShelveInstance-1263131412-project Oct 04 03:42:09.218291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Id: default Oct 04 03:42:09.218291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Domain-Name: Default Oct 04 03:42:09.218291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Id: 8efde9a6b5f044159cca51138d05e7e9 Oct 04 03:42:09.218291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: X-User-Name: tempest-TestShelveInstance-1263131412-project Oct 04 03:42:09.218291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: method: > Oct 04 03:42:09.218291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: exception: Instance 5974f447-5548-4412-bfa8-acef665100f6 could not be found. Oct 04 03:42:09.218291 dv-cinder-849143-9-smb devstack@n-api.service[120595]: action_args: {'id': '5974f447-5548-4412-bfa8-acef665100f6'} Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: {{(pid=120595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5974f447-5548-4412-bfa8-acef665100f6 could not be found. Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 03:42:09.219468 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5974f447-5548-4412-bfa8-acef665100f6 could not be found. Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5974f447-5548-4412-bfa8-acef665100f6 could not be found. Oct 04 03:42:09.221755 dv-cinder-849143-9-smb devstack@n-api.service[120595]: ERROR nova.api.openstack.wsgi Oct 04 03:42:09.223346 dv-cinder-849143-9-smb devstack@n-api.service[120595]: DEBUG nova.api.openstack.wsgi [None req-a601675a-4ce5-4daf-a0ba-42b4a1d4610f tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Returning 404 to user: Instance 5974f447-5548-4412-bfa8-acef665100f6 could not be found. {{(pid=120595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 03:42:09.223346 dv-cinder-849143-9-smb devstack@n-api.service[120595]: INFO nova.api.openstack.requestlog [None req-a601675a-4ce5-4daf-a0ba-42b4a1d4610f tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6" status: 404 len: 111 microversion: 2.1 time: 0.032341 Oct 04 03:42:09.223346 dv-cinder-849143-9-smb devstack@n-api.service[120595]: [pid: 120595|app: 0|req: 460/919] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Oct 4 03:42:09 2022] GET /compute/v2.1/servers/5974f447-5548-4412-bfa8-acef665100f6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 03:42:09.376897 dv-cinder-849143-9-smb devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-64fcc619-0289-4613-99a3-1cd95118d537 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] Calling method '.version_select at 0x7f165b59f550>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 03:42:09.383131 dv-cinder-849143-9-smb devstack@n-api.service[120594]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64fcc619-0289-4613-99a3-1cd95118d537 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [c2786f31-04a1-4f4d-a699-73381020f2b7] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 03:42:10.391327 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO oslo.messaging._drivers.impl_rabbit [None req-64fcc619-0289-4613-99a3-1cd95118d537 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] [c2786f31-04a1-4f4d-a699-73381020f2b7] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49832. Oct 04 03:42:10.409841 dv-cinder-849143-9-smb devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-64fcc619-0289-4613-99a3-1cd95118d537 tempest-TestShelveInstance-1263131412 tempest-TestShelveInstance-1263131412-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2132778266" status: 202 len: 0 microversion: 2.1 time: 1.037601 Oct 04 03:42:10.410422 dv-cinder-849143-9-smb devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 460/920] 10.222.0.25 () {58 vars in 1254 bytes} [Tue Oct 4 03:42:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2132778266 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)